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Foreword 


The International Civic and Citizenship Study (ICCS) 2022 continues IEA’s investi- 
gation into the ways in which young people understand and are prepared to be citizens 
in a world where contexts of democracy and civic participation continue to change. 
ICCS 2022 is the third cycle in the study’s current form, but is the fifth IEA study of 
this learning area. The International Association for the Evaluation of Educational 
Achievement (IEA) begun its investigation of civic and citizenship education, back 
in 1971 with nine countries participating in IEA’s Six Subject Survey. This inves- 
tigative effort continued with the 1999 IEA Civic Education Study (CIVED), which 
was implemented in 28 countries. Each of these earlier studies laid the foundation 
for IEA’s current study program of students’ civic knowledge, attitudes, and engage- 
ment, with important contributions to what ICCS is today—the only international 
study dedicated to exploring the ways in which students interact with the complex- 
ities of the modern global society, focusing on civic culture, social justice, human 
rights, and influences of the ever-changing political landscape. 

The need for sound data on both continuing and newly emerging topics of rele- 
vance for civic and citizenship education led to the establishment of ICCS 2009 as a 
baseline study with results on which findings from future cycles could be compared. 
The international survey was enriched through additional regional instruments that 
were developed for Asia, Europe, and Latin America to allow research of civic- 
related aspects that were of particular interest in these respective regions. Findings 
from ICCS 2009 and its subsequent second cycle in 2016 gave many interesting 
insights into the civic knowledge, beliefs, attitudes, and behaviors that students were 
developing and how these varied within and across countries as well as geographic 
regions. ICCS results have also provided information on young people’s percep- 
tions of democratic institutions and societal values. The output from the first two 
cycles of IC¢CS—compiled into international and regional reports, a civic and citizen- 
ship education encyclopedia, two technical reports, and two international databases 
accompanied by their respective user guides—further includes a wealth of data that 
are available for secondary research into a wide range of topics of relevance to this 
field. 
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Building on the previous cycles, in addition to the study of persisting issues already 
in focus, topics of particular contemporary relevance such as the impact of digital 
technology on civic engagement, migration and diversity, environmental sustain- 
ability, young people’s views of their political systems as well as global citizenship 
add further value to the wealth of information collected by ICCS 2022. It is also the 
first time that ICCS includes the option of a computer-based delivery, which will be 
administered in about two-thirds of participating countries. Since the study cycle’s 
inception, the COVID-19 global pandemic has further altered the context for civic 
and citizenship education as well as for the implementation of this particular study, 
and, as a result, ICCS 2022 has faced many challenges. However, IEA is confident 
that these developments have not compromised the integrity and quality of the current 
data collection and its participation standards. 

Twenty-three countries and two benchmarking entities are participating in ICCS 
2022, and this assessment framework provides insight into the study’s conceptual 
background, cognitive, affective-behavioral and contextual content, and assessment 
design. It also describes content relevant for the measurement of the United Nations’ 
Sustainable Development Goals (SDGs) that is related to Global Citizenship Educa- 
tion (GCED) and Education for Sustainable Development (ESD). Countries that 
participated in ICCS 2009, ICCS 2016, and ICCS 2022 will be able to monitor 
changes in their students’ civic knowledge, attitudes, and engagement over time. 
Apart from information on persisting issues relevant for this learning area, all partic- 
ipating countries in ICCS 2022 will additionally obtain data related to more recent 
developments with implications for civic and citizenship education, including student 
perceptions related to the recent COVID-19 pandemic. 

This framework is the compilation of the hard work of many dedicated institutions 
and individuals. IEA is grateful to the staff at the international study center at the 
Australian Council for Educational Research (ACER) for their work on constructing 
and implementing the study. These efforts were further supported by the collaboration 
with Laboratorio di Pedagogia Sperimentale (LPS) at the Roma Tre University, Rome 
and LUMSA University of Rome. Namely, I thank the ACER colleagues, Wolfram 
Schulz, Tim Friedman, John Ainley, Laila Halou, Judy Nixon, Nora Kovarcikova, 
Naoko Tabata, Greg Macaskill, Dulce Lay, and Abigail Middel as well as the LPS 
and LUMSA colleagues, Gabriella Agrusti, Bruno Losito, and Valeria Damiani for 
their support and perseverance. 

Additionally, the teams at IEA Hamburg and IEA Amsterdam who worked with 
the ICCS 2022 cycle were an invaluable addition to the quality of research included 
in, and publication of, this report. They include Julian Fraillon, Lauren Musu, Jan- 
Philipp Wagner, Katerina Hartmanova, Philippa Elliott, Katie Hill, Hannah Kowolik, 
Christine Busch, Ralph Carstens, Alena Becker, Diego Cortes, Umut Atasever, and 
Sabine Weber. Thank you for your foundational support during the development of 
this important study. 

Each participating national research center (NRC) and their staff offered crit- 
ical feedback that accumulated in sound implementation, and I am appreciative of 
the endurance in dealing with the many hardships brought on by the COVID-19 
pandemic. Thank you for your unwavering pursuit and enthusiasm that has greatly 
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contributed to the development of this framework. Further gratitude extends to the 
Project Advisory Committee (PAC), whose advice provided vital insight into current 
issues of relevance to the learning area and was essential to the development of 
this publication. The ICCS 2022 PAC consists of Erik Amna (Örebro University, 
Sweden), Cristian Cox (Diego Portales University, Chile), Babara Malak-Minkiewicz 
(IEA honorary member, the Netherlands), Judith Torney-Purta (University of Mary- 
land, United States), and Wiel Veugelers (The University of Humanistic Studies 
Utrecht, Netherlands). 

The framework underwent many revisions to match IEA’s very high publication 
standards and profited greatly from the review of IEA’s Publications and Editorial 
Committee (PEC). Many thanks go to Seamus Hegarty and the entire committee for 
their keen eye and established insights that have further elevated this publication. 

Amidst the turmoil of the pandemic and the ever-evolving landscape of civic and 
citizenship education, I must give my utmost thanks to the countries who participated. 
Itis the involvement of your local schools, students, and teachers that gives invaluable 
insight into how the next generation of citizens from many different parts of the 
world are forming an understanding and perceptions of increasingly complex topics 
about their society. IEA profoundly appreciates the work of each individual, at every 
level, who contributed to the research encapsulated in the ICCS 2022 framework and 
continues to inspire and shape the work to make this study a success. 


Amsterdam, The Netherlands Dirk Hastedt 
IEA Executive Director 
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Chapter 1 A) 
Overview Crock for 


1.1 Purpose of the Study 


The purpose of the International Civic and Citizenship Education Study (ICCS) is 
to investigate the changing ways in which young people are prepared to undertake 
their roles as citizens across a wide range of countries. In pursuit of this purpose, 
ICCS gathers data to report on students’ conceptual knowledge and understandings 
of aspects related to civic and citizenship education. It further collects and analyzes 
data about student attitudes and engagement relevant to the area of civic and citi- 
zenship education (Schulz et al., 2008, 2016). The International Association for the 
Evaluation of Educational Achievement (IEA) commissioned ICCS in response to 
widespread interest in continuing research on, and establishing regular international 
assessments of, civic and citizenship education. 

There has been an impressive history of IEA studies of civic and citizenship educa- 
tion (see Schulz, 2021; Torney-Purta & Schwille, 2011). The first IEA study of civic 
education was conducted as part of the Six-Subject Study,! with data collected in 1971 
(Torney et al., 1975), and the second study, the IEA Civic Education Study (CIVED), 
was carried out collecting data among 14-year-old students in 1999 followed by an 
additional survey of upper-secondary students in 2000 (see Torney-Purta et al., 2001; 
Amadeo et al., 2002). One decade later, IEA conducted ICCS 2009 as a baseline study 
for future assessments in this learning area (Schulz et al., 2008), which was then 
followed by its second cycle in 2016 (Schulz et al., 2016). Due to these efforts, IEA 
studies have provided invaluable datasets that are available for secondary analyses 
of issues related to civic and citizenship education across a wide range of national 
contexts (Knowles et al., 2018). 

The results of the first implementation of ICCS in 2009 were reported in a series 
of IEA publications (Ainley et al., 2013; Fraillon et al., 2012; Kerr et al., 2010; 


l In 1965 IEA inaugurated a cross-national survey of achievement in six subjects: science, reading 
comprehension, literature, English as a foreign language, French as a foreign language, and civic 
education. 
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Schulz et al., 2010, 2011) and have also led to numerous reports and publications 
within countries. The 2016 iteration of ICCS explored both the enduring and the 
emerging challenges to educating young people in a world where contexts of democ- 
racy and civic participation continue to change, and it reported on changes in selected 
outcomes and contexts between 2009 and 2016 (Losito et al., 2018; Schulz et al., 
2018a, 2018b). 

In recent years, there have been many developments with implications for civic and 
citizenship education. While notions of citizenship and identities defined by nation 
states continue to be challenged by globalization, migration, and the establishment 
of supra-regional organizations, there is also a broadening of the scope of issues 
which societies have to respond to. These go beyond national borders and attract 
worldwide prominence, opening questions about the extent to which young people 
are prepared to engage not only in their regional or national societies but on a global 
scale. Types of engagement are also changing with the pervasiveness of informa- 
tion flows through digital technologies and associated opportunities for new ways of 
participation (Brennan, 2018; Kahne et al., 2014; Theocharis & Van Deth, 2018). In 
addition, political systems once thought to be stable (such as long-established democ- 
racies) show signs of instability and the rise of new political movements that are often 
formed in response to globalization, growing economic inequalities, and increased 
migration (European Commission, 2016; Eurostat, 2018; UNESCO [United Nations 
Educational, Scientific and Cultural Organization], 2018). 

The third cycle of ICCS, with a data collection in 2022, was developed in consid- 
eration of ongoing developments and challenges in civic and citizenship education. 
Similar to ICCS 2016, it combines the goal of monitoring changes over time regarding 
students’ civic knowledge, attitudes, and engagement with the aim of investigating 
new or broadened aspects that are relevant for this learning area in the current contexts 
for participating countries. In particular, ICCS 2022 extends the scope of ICCS 2016 
to explore further content and themes associated with global citizenship, sustain- 
able development, migration, changes to traditional political systems, and the use of 
digital technologies for civic engagement. 

For the first time, ICCS 2022 also offers countries the option of assessing students 
using a computer-based delivery platform as an alternative to the paper-based delivery 
applied in previous study cycles. Like other IEA studies, ICCS is transitioning from 
paper-based to computer-based assessment, a form of data collection that is becoming 
more and more prevalent in national as well as cross-national studies. Computer- 
based assessment offers opportunities for measuring cognitive skills in ways that are 
not available for paper-based assessment by providing an interactive environment 
for civic-related tasks that are undertaken using digital technologies. 
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1.2 Study Background 


Civic and citizenship education is implemented to provide young people with knowl- 
edge, understanding, and dispositions considered necessary to participate success- 
fully as citizens in society. Young people should understand civic principles and 
institutions, know how to engage in civil society, be able to exercise critical judg- 
ment, and develop an understanding and appreciation of the rights and responsibili- 
ties of a citizen. Developing these attributes in young people is key to a functioning 
democracy, which depends on citizens as actively involved agents regarding decision- 
making, governance, and change. This can be seen to contrast with authoritarian and 
non-democratic regimes, where the role of citizens is rather one of passive obedi- 
ence. Furthermore, in view of the increasing cultural diversity within many modern 
societies, ICCS also seeks to contribute to the understanding of how this diversity 
impacts on civic and citizenship education and how young people respond to this in 
terms of their knowledge, engagement, and attitudes. Civic competences are increas- 
ingly also regarded as part of a broader skill set required in workplaces (Gould, 2011; 
Torney-Purta & Wilkenfeld, 2009). As such, they are not only of interest to polit- 
ical and community leaders, but also of value to and valued by a growing number 
of employers (OECD [Organisation for Economic Cooperation and Development], 
2015). 

There is a large body of scholarly work emphasizing the importance of political 
socialization processes among young people for the formation of attitudes and dispo- 
sition for engagement (van Deth et al., 2007; Neundorf & Smets, 2017; Myoung & 
Liou, 2022). Although early work assumed strong and enduring influences on later 
political orientations, subsequent studies show evidence for the changeability of 
attitudes during socialization and characterize political orientation as a process of 
learning (Searing et al., 1976; Niemi & Klinger, 2012; Rekker et al., 2015; Peterson 
et al., 2020). Scholars have postulated that young people tend not to have already 
developed enduring beliefs and are therefore open to be influenced by external factors 
(see, for example, Sears & Levy, 2003). Research has also highlighted the features of 
youth political participation when compared to political engagement among adults 
(Weiss, 2020). 

Parents and home environments have been emphasized as particularly important 
agents in the process of early political socialization (Bourdieu, 1996; Jennings et al., 
2009; Lauglo, 2011; Reay, 1998), but there is also ample evidence about the influence 
of peers and media (for example, Wattenberg, 2008; Campos et al., 2017), political 
events (Dinas, 2013), and school education (Lee et al., 2021; Nie & Hillygus, 2001; 
Torney-Purta, 2002). School education has the potential of compensating for less 
enriching backgrounds in developing political socialization and may interact with 
other factors that contribute to the development of citizenship orientations (Hoskins 
et al., 2017; Neundorf et al., 2013, 2016). Even though the later years of adolescence 
and early adulthood have been regarded as formative and “impressionable” years, 
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there is evidence that late childhood and early adolescence are also of crucial impor- 
tance for developing citizenship orientations (Bartels & Jackman, 2014; van Deth 
et al., 2011). 

There has been a long tradition in academic work on educational policy and prac- 
tice to highlight the importance of education for instilling democratic values (Dewey, 
1916). In this context it is noteworthy that cross-national data demonstrate that many 
countries nowadays include civic and citizenship education explicitly in their national 
curricula (Ainley et al., 2013; Cox, 2010; European Commission/EACEA [The Euro- 
pean Education and Culture Executive Agency ]/Eurydice, 2017). There is evidence 
from various research studies that the classroom climate plays an important role in 
shaping civic-related learning outcomes, while the effects of aspects of curricula are 
less well studied (Geboers et al., 2013). 

Traditionally, concepts underlying civic and citizenship education have typically 
been associated with the notion of nation states. The establishment of suprana- 
tional organizations (such as the EU [European Union]), increased migration across 
borders, and pressure from globalization have challenged traditional notions of civic 
and citizenship education and prompted the development of cross-national concepts 
such as “global citizenship” (Brodie, 2004; Pashby et al., 2020; Reid et al., 2010; 
Schattle, 2012; Veugelers, 2011). One interpretation of this development has been 
linked to a consideration of the implications of increasing diversity, and multicultur- 
alism, for citizenship and identity (Modood & Meer, 2013; Morrell, 2008). However, 
other research has indicated that the notion of a nation state, sometimes even including 
nationalistic perspectives, continue to prevail in curricula for civic and citizenship 
education (Fozdar & Martin, 2020; Kennedy, 2012; Osler, 2011). 

Conover (1995) conceptualizes citizenship as consisting of three elements: (1) 
formal and informal aspects of citizenship as membership of a political community, 
(2) a “sense of citizenship” which is made up of citizenship identity and an under- 
standing of what is involved in citizenship, and (3) citizenship practices involved in 
political participation and civic engagement. In ICCS we have adopted a view that 
is broadly consistent with this long-established definition because it facilitates an 
extension of the notion of citizenship beyond the level of nation states. 

The concept of social cohesion is also important in civic and citizenship education. 
Social cohesion is a complex notion that broadly refers to the extent and strength of 
links and connections between individuals, groups, organizations, and communities. 
Although the concept has been criticized for its lack of clarity (Green & Janmaat, 
2011), it is a useful reference point for a comparative study such as ICCS (Reichert 
et al., 2021; Veerman et al., 2021). In the context of ICCS, we apply a broad definition 
of social cohesion as “‘a state of affairs concerning both the vertical and the horizontal 
interactions among members of society as characterized by a set of attitudes and 
norms that includes trust, a sense of belonging, and the willingness to participate and 
help, as well as their behavioral manifestations” (Chan et al., 2006, p. 289f.). 
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1.3 Recent Developments and Persisting Challenges 


Since ICCS 2016, there have been changes regarding the global context for civic and 
citizenship education, with implications for this learning area. Additionally, certain 
challenges in the study of civic and citizenship education continue to persist. The 
following topics and results from ICCS 2016 are important to consider and relevant 
to a study of civic and citizenship education (Schulz, 2018; Schulz et al., 201 8b): 


e Monitoring civic learning in relation to changing contexts for civic and citizenship 
education: ICCS 2016 results indicated increases in civic knowledge since 2009 
in about half of the participating countries, even though considerable variation 
remained within and across countries. 

e Reviewing patterns of, and dispositions toward, civic engagement: ICCS 2016 
results suggested changes in patterns since 2009 with respect to; the use of 
media information, increases in discussions about political and social issues, and 
expected civic participation in some countries; however, students with greater 
knowledge and understanding of the area in in both ICCS 2009 and 2016 were 
less inclined to consider future active political participation (using conventional 
channels) than those with less knowledge and understanding. 

e Gathering data on student attitudes towards citizenship and equal rights: Results 
from ICCS 2016 indicated strong support for equal rights as seen in the previous 
cycle, as well as some increases in tolerance; however, interpretations of positive 
and negative situations for democracy were not always consistent across countries. 

e Providing a more comprehensive coverage of information about the school as 
a place for learning: ICCS 2016 results provided further insights into the role 
of schools as a place for the learning of civic and citizenship issues and for 
experiencing a democratic environment where students can practice their rights 
and responsibilities as young citizens; however, the results also indicated that 
more information is needed regarding the responsiveness of schools to student 
needs, their support of students’ sense of belonging to the school community, and 
their provision of support for engagement with cognitive aspects of civic learning. 


For ICCS 2022, the following global developments that have become particularly 
relevant over recent years are considered: 


e Increased globalization and migration, as well as the changing causes for migra- 
tion (in particular growing numbers of refugees escaping war zones or political 
oppression) that challenge notions of citizenship tied to nation states. There is 
a need to consider these global developments in the context of the contents and 
goals of civic and citizenship education, including recent movements that reject 
globalization and demand a return to nationally defined priorities (Bauman, 2016; 
Reimers, 2013; UNESCO, 2015). 

e Growing awareness of the implications of increasing diversity for civic and citi- 
zenship education, with an emphasis on how schools consider and acknowledge 
diversity in societies regarding characteristics such as ethnicity, religion, gender, 
sexual orientation, or disability (Banks, 2001; Osler, 2012; Sincer et al., 2019). 
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Increasing awareness of environmental issues and concerns about the conse- 
quences of climate change for the future of this planet, which has led to the 
phenomenon of international youth movements, such as Fridays for Future (De 
Moor et al., 2020; Marquardt, 2020), and there has also been a formal recogni- 
tion of the global significance of Education for Sustainable Development as well 
as Global Citizenship Education through their inclusion in the United Nations 
2030 Agenda for Sustainable Development, specifically in form of the Sustain- 
able Development Goal Target 4.7 (SDG: 4.7) (Council of the European Union, 
2021; United Nations, 2015, p. 17; UNESCO, 2020, 2021). 

e The growing importance of information exchange and engagement through digital 
media that have had important implications for how citizens inform and express 
themselves about current events and how they interact using alternative chan- 
nels of engagement (Anduiza et al., 2012; Bachen et al., 2008). Furthermore, 
there are questions connected to this issue regarding the risks associated with this 
development such as the treatment of private information, increases in threatening 
and aggressive communication (“hate speech”), and concerns that young people 
lack the ability to distinguish reliable from misleading information (Howard & 
Hussain, 2011; Kaufman, 2020; McGrew et al., 2017). 

e Political developments in many countries that have led to a weakening of tradi- 
tional political systems and even threatened the stability of long-standing democ- 
racies. These developments may be related to alienation of groups in society, often 
related to economic inequalities, and raise questions about the future engagement 
of young people (Boogards, 2017; Hobolt et al., 2016; Inglehart & Norris, 2016). 

e In early 2020, civil societies across the globe were challenged by the outbreak 
of the COVID-19 pandemic that led to restrictions on freedom of movement and 
democratic participation. The advent of national emergencies has raised questions 
about aspects of democratic processes including the acceptance of restrictions on 
individual freedom and the appropriateness of delegating more power to an execu- 
tive during times of crises (Marzocchi, 2020; Landman & Di Gennaro Splendore, 
2020) as well as about the capacity of democracies to handle such situations (Frey 
et al., 2020). 


1.4 Broadening the Scope of ICCS Content 


To consider recent developments and persisting challenges within the global context, 
we identified content focus areas for the third cycle of ICCS. It is important to 
acknowledge that certain new or refined aspects measured in ICCS 2022 may have 
relevance for more than one of the focus areas (for example, perceptions of diversity) 
and that relevant content for each of these areas was already included in earlier ICCS 
surveys. 

The focus areas are: 


e Sustainability 
e Engagement through digital technologies 
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e Diversity 
e Young people’s views of the political system 


One further area was also identified as deserving more explicit recognition given 
that it is an overarching area related to aspects already present in ICCS or to the focus 
areas listed above: 


e Global citizenship 


In the following section, we provide brief descriptions of each of these five focus 
areas for ICCS 2022. 


1.4.1 Sustainability 


Education for sustainable development (ESD), frequently treated in conjunction with 
Global Citizenship Education (GCED, has become an important area of interest 
in view of many pre- existing and newly emerging demographic, environmental, 
economic, and social challenges (see, for example, Bromley et al., 2016; Bourn 
et al., 2017; Wals & Benavot, 2017). While some scholars have noted that there 
is a lack of conceptual agreement across research and practice of ESD (see, for 
example, Kopnina & Meijers, 2014), there is evidence of increasing efforts to incor- 
porate content related to this area in national curricula (Benavot, 2014). At the inter- 
national level, there have been initiatives to promote ESD through the formula- 
tion of learning objectives (UNESCO, 2017, 2020, 2021) and to assess the extent 
of ESD-related topics across national curricula (UNESCO International Bureau 
for Education, 2016). Cross-national research has highlighted the complexities of 
implementing ESD content in secondary education (Taylor et al., 2019) and it has 
shown embedding this learning area in initial teacher education as an emerging 
area of activity that continues to lack systematic approaches with solid conceptual 
underpinning (Evans et al., 2017). 

In particular, the potential impact of climate change has increasingly raised serious 
concerns about the sustainability of human development. This issue has been identi- 
fied as a public concern in opinion surveys across the globe, even though there have 
also been differences in perception across countries (Pew Research Center, 2019). 
Consequently, there have been calls to strengthen ESD in national school curricula 
to provide young people with better knowledge about, and better understanding of, 
the causes and consequences of climate change (Mochizuki & Bryan, 2015). 

The ICCS 2016 assessment framework (Schulz et al., 2016) included environ- 
mental sustainability in civic and citizenship education as one of three areas iden- 
tified for inclusion to broaden the scope of the second ICCS cycle (together with 
social interaction at school and use of new social media for civic engagement). This 
helped establish ICCS as a data source for ESD (and GCED) indicators (Sandoval- 
Hernandez et al., 2019). For ICCS 2022, we incorporate the broader notion of sustain- 
ability that includes content associated with environmental, social, and economic 
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sustainability, with the aim of increasing the emphasis on ESD and the amount of 
ESD-related content compared to previous cycles of ICCS. 


1.4.2 Civic Engagement Through Digital Technologies 


Over the last two decades, young people have increasingly interacted via digital 
communication and social media. Digital technologies provide new possibilities for 
mobilization, organization, and interaction of wider audiences (Brennan, 2018), and 
in particular of young people, including the formation of digital communities intro- 
ducing types of behaviors that are unique to the online environment (Cho, 2020). The 
use of social media and the internet is widely regarded as having profound effects 
on civic engagement among youth, and research suggests that new social media can 
be effective in enhancing civic participation while also having potential negative 
consequences for society (Kahne & Bowyer, 2019; Kahne et al., 2012; Middaugh 
et al., 2016; Rainie et al., 2012). 

In these new media, content is often created interactively rather than through one- 
way communication as evident in traditional media, and these developments may 
have implications for civic and citizenship education (Kahne et al., 2016). There 
have also been calls to arrange better support to facilitate the use of such technolo- 
gies among communities (Wenger et al., 2009). In response to these developments, 
a concept of “digital citizenship” has emerged, which refers to membership in a 
community defined by their use of information and communication technology (ICT) 
to engage in society, politics, and government (see, for example, Frau-Meigs et al., 
2017; eTwinning, 2016; Mossberger et al., 2008; Christensen et al., 2021). 

Engagement through digital technologies can be regarded as a relatively new form 
of civic participation that facilitates obtaining information and engaging with others. 
However, it is important to recognize that the collective use of digital tools may also 
have severe impacts on safe, effective, and responsible participation (Choi, 2016). 
Negative consequences of increasing civic engagement with digital technologies 
include its exploitation by extremist groups (e.g., by making it easier to dissemi- 
nate “hate speech”) (Tynes et al., 2015) or the potential impact of inaccurate online 
information (see, for example, Heflin, 2015). Furthermore, the possibility of limiting 
people’s information intake to web-based communication from like-minded sources 
may also contribute to the polarization of opinions (Spohr, 2017). 

ICCS 2016 identified the use of social media for civic engagement as one of 
the areas in which to broaden the scope of the study, and its student questionnaire 
included a (limited) set of new items focused on the use of these media for civic 
engagement. While results from ICCS 2016 (Schulz et al., 2018b) showed that the 
use of social media for civic engagement remained limited (albeit with substantial 
variation across participating countries), it is likely that the use of social media for 
civic engagement may increase further over time given this form of media’s general 
pervasiveness. A recent example of the crucial role of social media in promoting 
youth activism at a global level is the School Strike 4 Climate movement, where the 
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Twitter platform was used extensively as a forum for mobilization (Boulianne et al., 
2020). ICCS 2022 continues to monitor young people’s civic engagement through 
digital technologies, including their participation via social media. 


1.4.3 Diversity 


The increasing diversity of student populations is a global educational trend and 
affects schools and other educational institutions by posing obstacles (see examples 
regarding the effects on civic and citizenship education in some countries in Malak- 
Minkiewicz & Torney-Purta, 2021), but also providing opportunities for building 
multicultural and inclusive schools (Banks, 2020; Banks & McGee Banks, 2009; 
Griffith et al., 2016). In today’s globalized world, recent economic, demographic, 
and technological changes have made international migration more wide-spread so 
that it affects nearly all countries (Sandoval-Hernandez et al., 2018; OECD, 2012; 
United Nations, Department of Economic and Social Affairs, Population Division, 
2017). Working with cultural diversity is frequently seen as an opportunity as well as 
a challenge (Hattam, 2018), and civic and citizenship education provides a potential 
tool for the integration of diverse groups into society (Banks, 2017, 2021). Some 
researchers have argued for viewing diversity as a resource for enriching school 
education through the promotion of knowledge and respect for other cultures (Council 
of Europe, 2018; Schachner, 2014, 2019; Schachner et al., 2016). 

It is important to emphasize that the concept of diversity embraces a wide range 
of socially ascribed or perceived differences, such as by sex, age, ethnic/social 
origin, language, religion, nationality, economic condition, or special learning needs 
(Daniels & Garner, 1999). These differences could represent a reason for, exclu- 
sion from or limitation to, educational opportunities and lead to social exclusion in 
adulthood. According to the United Nations (2016) “social exclusion is a multidi- 
mensional phenomenon not limited to material deprivation; poverty is an important 
dimension of exclusion, albeit only one dimension. Accordingly, social inclusion 
processes involve more than improving access to economic resources” (p. 17). The 
philosophy and practice of inclusion has recently received growing attention in terms 
of equal opportunities for education in many countries, however, there are also still 
wide-spread debates about how to define inclusive schools. 

The ICCS 2016 assessment framework already addressed issues related to migra- 
tion and its effects on debates about civic and citizenship education. Students’ 
attitudes concerning migration issues were included in three of the four content 
domains related to the affective-behavioral domain attitudes, in particular regarding 
students’ attitudes toward civic society and systems, civic principles, and civic iden- 
tities (Schulz et al., 2016). However, in view of recent developments, ICCS 2022 
assesses a broader range of aspects including how schools and civic and citizenship 
education accommodate increasing diversity. 
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1.4.4 Young People’s Views of the Political System in Their 
Country 


Over the past decade there have been growing concerns regarding a worldwide 
“democratic recession” (Diamond, 2015, 2021). These have arisen in response to 
an observable increase across many countries in authoritarian government practices 
as well as new political movements that have undermined support for traditional polit- 
ical parties, and, in some cases have challenged the stability of democratic systems 
(Boogards, 2017; Mair, 2002). For civic and citizenship education these recent devel- 
opments raise the question to what extent tendencies toward alienation and an under- 
standing of and preference for populist solutions to government are shared by young 
people (Gidron & Hall, 2020; Henn & Weinstein, 2006), and whether education has 
the potential of promoting democratic principles to counteract prospects of growing 
alienation among young citizens (Estellés & Castellvi, 2020; Sant, 2019). Further- 
more, as a response to the outbreak of the COVID-19 pandemic, there have also 
been new recent challenges to democratic government in the form of restrictions of 
individual freedom and citizen participation (Marzocchi, 2020). 

Young people’s views of the political system were addressed in ICCS 2009 and 
2016, both in the international and regional student questionnaires. While results from 
these two surveys showed considerable support for democratic government and equal 
opportunities across countries, this was less consistent for issues related to media 
diversity, individual freedom within the context of national security considerations, 
or (in some countries) regarding nepotism in politics, corruption, and authoritarian 
government. New aspects for measurement in ICCS 2022 are related to attitudes 
toward government and the political system as well as perceptions of potential threats 
to democracy. Furthermore, the study also addresses beliefs about the extent to which 
democratic governments should be able to impose restrictions on individual freedom 
during national emergencies, such as the outbreak of the COVID-19 pandemic. 


1.4.5 Global Citizenship 


Global Citizenship Education has received considerable attention in debates about 
the needs for identifying global education targets in view of an increasing cross- 
national interconnectedness and the globalization of political, social, economic, and 
environmental issues (Veugelers, 2011). However, definitions of this area have often 
been inconsistent (Oxley & Morris, 2013; Pashby et al., 2020). UNESCO describes 
global citizenship as, “a sense of belonging to a broader community and common 
humanity. It emphasizes political, economic, social and cultural interdependency and 
interconnectedness between the local, the national and the global” (UNESCO, 2015, 
p. 14). 

Many aspects of the conceptual content associated with GCED have been included 
in IEA studies relating to civic and citizenship education for over 40 years (see Torney 
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et al., 1975; Torney-Purta et al., 2001; Schulz et al., 2008, 2016). However, these 
aspects were included in previous IEA studies because they were regarded as within 
the existing scope of civic and citizenship education programs across countries, 
rather than emerging from a new area with its own theoretical or educational focus. 
As such, content and concepts associated with this area in earlier IEA studies of civic 
and citizenship education were not explicitly linked to GCED perspectives and were 
not grouped or explicitly described as belonging primarily to either area. For ICCS 
2022, GCED-related content is more explicitly recognized within this assessment 
framework with a view to increasing the emphasis given to this overarching area, 
and this study continues to be the only international study dedicated to providing 
empirical data on youth attitudes toward and engagement with global issues. 


1.5 Computer-Based Delivery 


Many international comparative studies, as well as national large-scale assessments, 
have moved to or are currently transitioning to computer-based forms of assessment 
(Beller, 2013; Sibberns, 2020). For the first time in the context of ICCS, this cycle 
offers the option of a computer-based delivery of the study’s student survey, and about 
two thirds of participating countries chose this new delivery mode. In this context, 
it is important to note that online delivery of teacher and school questionnaires has 
already been available across all cycles of ICCS since its inception in 2009. The 
number of countries and respondents within countries making use of online delivery 
of the teacher and school questionnaires has increased across the ICCS cycles, and 
online delivery is expected to also become the standard mode of data collection for 
these contextual instruments in future ICCS cycles. 

One important argument for moving to computer-based delivery is that informa- 
tion about political and social issues is increasingly presented through electronic 
media, and that there is a growing potential for civic engagement via social media 
and other web-based tools. Here, computer-based delivery offers an opportunity 
to provide digital assessment content that reflects how a growing proportion of 
students experience content related to civic and citizenship issues. While most parts 
of the students’ cognitive assessment are delivered using the same format across 
both computer and paper modes, computer-based assessment also includes modules 
that measure students’ knowledge through the provision of computer-enhanced item 
material. These computer-enhanced modules place students in simulated participa- 
tory real-world scenarios using the online context. As part of each scenario, students 
complete dynamic interactive tasks that include some form of feedback to their 
responses. The interactivity of the tasks, the opportunity for dynamic feedback and 
the narratives that place the students as participants in civic action within a digital 
environment are what differentiate the computer enhanced modules from items that 
are completed both on paper and computer. 

Like other international studies, ICCS 2022 faces the challenge of ensuring 
comparability of results from computer-based and paper-based administration of its 
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instruments. This is important both in terms of comparing country results across the 
two modes present in the study, as well as with results from the previous (paper-based) 
assessment. While experience has shown that there is a potential for mode effects, 
results also show that there is considerable consistency regarding the measurement 
of constructs (see, for example, Fishbein et al., 2018). 


1.6 Research Questions 


The key research questions for ICCS 2022 concern students’ civic knowledge, their 
dispositions to engage, and their attitudes related to civic and citizenship issues as 
well as contexts in this learning area. Each of the following general research questions 
(RQs) relate to a subset of specific research questions that will be addressed in ICCS 
2022. 


RQ1 How is civic and citizenship education implemented in participating coun- 
tries? This research question is concerned with the national contexts for 
civic and citizenship education and includes the following specific research 
questions: 


(a) What are the aims and principles of civic and citizenship education in 
each participating country? Analyses will focus on information from the 
national contexts survey and published sources about the background 
and intentions behind civic and citizenship curricula in participating 
countries. 

(b) Which curricular approaches do participating countries choose to 
provide in civic and citizenship education? Analyses will focus on 
different types of civic and citizenship education implemented in partic- 
ipating countries and will be based on national contexts survey data, 
published sources, teacher survey and school survey data. 

(c) What changes and/or developments in this learning area can be observed 
since the 2009 and 2016 cycles? Analyses will only include data from 
countries participating in the corresponding ICCS surveys from 2016 or 
2009 and focus on reforms and changes in the national contexts for civic 
and citizenship education. 

(d) How do education systems, schools, and educators perceive the role of 
civic and citizenship education across participating countries? Anal- 
yses will address how teachers and school principals perceive, and how 
national curricula and policies state, the role that schools and teachers 
should play in preparing young people for citizenship. 


RQ2 What is the extent and variation of students’ civic knowledge within and 
across participating countries? Analyses to address this research question 
primarily focus on student test data and encompass the following specific 
research questions: 
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RQ3 


RQ4 


(a) 


(b) 


(c) 


Are variations in civic knowledge associated with student character- 
istics and background variables? Analyses will investigate the influ- 
ence of student gender, socioeconomic indicators, and other background 
variables on civic knowledge. 

What contextual factors explain variation in students’ civic knowledge? 
Analyses will study the relationship between contextual variables at 
different levels with variation in students’ civic knowledge. 

What changes in civic knowledge have occurred since the previous survey 
cycles? Analyses will be limited to those countries participating in the 
corresponding ICCS surveys and require comparable measures of civic 
knowledge over time. 


What is the extent of students’ engagement in different spheres of society 
and which factors within or across countries are related to it? This research 
question is related to indicators of student engagement and encompasses the 
following specific research questions: 


(a) 


(b) 


(c) 


(d) 


What beliefs do students hold regarding their own capacity to engage 
and the value of civic participation? Analyses will focus on student 
perceptions of civic engagement. 

What is the extent and variation of students’ civic participation in and out 
of school? Analyses will focus on student reports on their past and current 
involvement in civic-related activities, as well as their communication 
about civic-related issues (including engagement with new electronic 
media). 

Which expectations do students have regarding civic and political partici- 
pation in the future? Analyses will address students’ behavioral intentions 
regarding different forms of civic or political participation. 

What changes in the extent and forms of student engagement can be 
observed since the previous ICCS cycles? Analyses will include data 
from those countries participating in the corresponding ICCS surveys 
and engagement indicators included in both studies. 


What beliefs do students in participating countries hold regarding important 
civic issues in modern society and what are the factors influencing their vari- 
ation? This research question is related to different student affective measures 
and encompasses the following specific research questions: 


(a) 


(b) 


What are students’ beliefs regarding the importance of different principles 
underlying a democratic society? Analyses will focus on students’ value 
beliefs regarding democracy and citizenship, as well as issues related 
to concerns about global citizenship and sustainable development on a 
world-wide scale. 

What attitudes do students hold toward civic institutions and society? 
Analyses will address the way students perceive society in general, its 
rules and institutions. 
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(c) What are students’ perceptions of social cohesion and diversity in the 
societies they live in? Analyses will be related to students’ acceptance 
of equal rights and opportunities for all social groups, acceptance of 
diversity, and peaceful coexistence. 

(d) What changes in student beliefs can be observed since previous ICCS 
cycles? Analyses will include only data from those countries participating 
in the corresponding ICCS surveys and affective measures included in 
both studies. 


RQ5 How is schooling in participating countries organized with regard to civic 
and citizenship education and what is its association with students’ learning 
outcomes? This research question is related to the ways schools (within their 
community context) provide spaces for civic and citizenship education, and 
encompasses the following specific research questions: 


(a) To what extent do schools in participating countries have participatory 
processes in place that facilitate civic engagement? Analyses will be 
based on student, teacher, and school survey indicators regarding the 
school climate for participation at school and civic engagement. 

(b) Yo what extent do schools and communities interact to foster students’ 
civic engagement and learning? Analyses will include student, teacher, 
and school survey data related to the schools’ interactions with the wider 
community (from local communities to interaction via web-based media) 
as well as opportunities for students’ active civic involvement. 

(c) To what extent do schools offer programs or activities related to civic 
learning and experiences (including activities related to global aware- 
ness, environmental sustainability, peaceful coexistence, engagement at 
local, national and global levels, and responsible use of social media)? 
Analyses will include student, teacher, and school survey data. 


1.7 General Study Design 


Consistent with previous ICCS cycles (Weber, 2018; Zuehlke, 2011), the student 
population to be surveyed consists of students in their eighth year of schooling 
(including students who are approximately 14 years of age). Typically, ICCS 2022 
assesses Grade 8 students, provided that the average age of students at this year level 
is 13.5 years or above. In countries where the average age of students in Grade 8 
is less than 13.5 years, Grade 9 is defined as the target population. In each sampled 
school, intact classrooms are selected, and all students in a class are assessed for the 
ICCS 2022 survey. Assessing this grade is in line with practice in other IEA studies 
that survey lower-secondary students across different learning areas. 

The definition of the target population of teachers is also the same as in the previous 
ICCS cycles. ICCS 2022 surveys all teachers teaching regular school subjects to 
students in the target grade at each sampled school but is limited to those teachers 
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teaching the target grade during the testing period and employed at the school 
since the beginning of the school year. At each participating school, 15 teachers 
are randomly selected, and, in schools with fewer than 20 teachers, all of them 
are surveyed. As in previous implementations of ICCS, there is also an international 
option to ask teachers of civic-related subjects at the target grade additional questions 
on civic teaching and learning. 

An important unique feature of ICCS is the administration of additional regional 
instruments. ICCS 2009 included regional instruments for countries in Asia, Europe, 
and Latin America (Agrusti et al., 2018; Fraillon et al., 2012; Kerr et al., 2010, 
2011; Schulz et al., 2011), while ICCS 2016 administered student questionnaires 
for European and Latin American participants (Agrusti et al., 2018; Losito et al., 
2018; Schulz et al., 2018a). ICCS 2022 once again includes regional instruments for 
countries in Europe and Latin America that are developed to assess region-specific 
aspects of civic and citizenship education. The content of the regional instruments 
focuses on topics that are not covered in the international survey material and of 
particular relevance in the countries of the particular geographic region. 

The following instruments are administered as part of the ICCS 2022 survey: 


e An international student test consisting of items measuring students’ civic knowl- 
edge and ability to analyze and reason. The instrument is either administered on 
paper or using the computer-based delivery platform. 

e An international student questionnaire consisting of items measuring student 
background variables and student perceptions. The instrument is either adminis- 
tered on paper or using the computer-based delivery platform. 

© Regional student instruments consisting of questionnaire-type items. These instru- 
ments are only administered in countries participating in the European and Latin 
American modules. The instruments are either administered on paper or using the 
computer-based delivery platform. 

e A teacher questionnaire, administered to selected teachers teaching any subject 
in the target grade. It gathers information about teacher background variables 
and teachers’ perceptions of factors related to the context of civic and citizen- 
ship education in their respective schools. As in previous ICCS cycles, partici- 
pating national centers have the option of offering an online administration of this 
questionnaire. 

e A school questionnaire, administered to school principals of selected schools to 
capture school characteristics and school-level variables related to civic and citi- 
zenship participation. As with the teacher questionnaire, the school questionnaire 
may be completed online by respondents in countries participating in the option 
of an online delivery. 

e The national contexts survey, completed online by national center experts, is 
designed to gather data about the structure of the education systems, the status 
of civic and citizenship education in the national curricula, and recent develop- 
ments in the area. The data obtained from this survey will supplement published 
information sources about countries and their education systems to assist with the 
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interpretation of the results from the student, school, and teacher instruments, and 
in describing national contexts for civic and citizenship education. 


1.8 Characteristics and Structure of the ICCS 2022 
Assessment Framework 


The assessment framework provides a conceptual underpinning for the international 
instrumentation for ICCS 2022. It needs to identify and define those aspects of cogni- 
tive and affective-behavioral content that should be considered important learning 
outcomes of civic and citizenship education, as well as contextual factors that are 
setting the context for students’ civic learning. It should be noted that within the 
context of this framework, the term “learning outcomes” is used in a broad way and 
that it is not intended to confine civic and citizenship education to school learning or 
any specific theoretical perspective. The way students develop civic knowledge and 
understanding, as well as affective-behavioral dispositions towards civic and citizen- 
ship issues, potentially depends on many factors, including those beyond the learning 
environment at schools (see Amna et al., 2009; Neundorf et al., 2016; Pancer, 2015; 
Pancer & Pratt, 1999; Wray-Lake, 2019). 

The development of young people’s knowledge and understanding of content and 
concepts related to civic and citizenship issues is one of the primary aims of this 
particular learning area. The importance of such knowledge and understanding lies 
also in the fact that it crucially underpins the ability of citizens to engage productively 
in society. Cross-national measurement of civic knowledge and understanding has 
been key to IEA studies relating to civic and citizenship education. The resulting 
data have provided important insights into the role of cognitive knowledge. The 
ICCS 2022 Civic Knowledge Framework (Chap. 2) describes aspects of students’ 
civic knowledge in terms of their content and the cognitive processes associated with 
it that are measured with ICCS 2022 student test items. 

Civic and citizenship education provides opportunities for active participation, 
promotes the development of attitudes towards important aspects of civic life, and 
develops dispositions in young people to make positive contributions to their soci- 
eties. Results from IEA studies investigating this learning area have contributed to 
the recognition that, as students acquire knowledge and understanding of aspects 
of civic and citizenship issues, it is also of crucial importance to investigate their 
attitudes to, and dispositions to participate in, civic life. Conversely, it should also be 
emphasized that as young people develop interests and inclinations toward engage- 
ment in civic life, they also learn and understand more about key aspects of civic 
and citizenship issues. The ICCS 2022 Civic Attitudes and Engagement Framework 
(Chap. 3) describes affective-behavioral constructs that are measured with student 
questionnaire items included in international and regional instruments. 

ICCS has drawn on the conceptual model used in CIVED 1999 in its investigation 
of how young people are prepared for their roles as citizens through its emphasis on 
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how individual students are influenced by different “agents of socialization” (Torney- 
Purta et al., 2001, p. 21). While ICCS as a study of civic and citizenship education 
places an emphasis on the role of schools, it assumes that learning of civic and 
citizenship content as well as the development of civic-related attitudes and dispo- 
sitions toward engagement are a product of processes that take place in different 
environments and are not confined to school learning. Young people acquire knowl- 
edge, attitudes, and behavioral dispositions through interactions with a wide range of 
potentially significant actors and the various communities with which they are and/or 
feel associated. The ICCS 2022 Contextual Framework in Chap. 4 describes the vari- 
ables that set civic-related cognitive and affective-behavioral learning outcomes into 
context, and that are measured by student, teacher and school questionnaires as well 
as the national contexts survey. 

Compared to the conceptual frameworks for ICCS 2009 and 2016, a major change 
implemented in the ICCS 2022 assessment framework is that the previous civic and 
citizenship framework (describing both cognitive and affective-behavioral content) 
is now presented in two separate frameworks, the civic knowledge framework and 
the civic attitudes and engagement framework. This was implemented to simplify the 
structure of the assessment framework and make it more internally consistent. It is 
important to note that these changes to the structure do not affect the comparability 
of content and scope of ICCS 2022 with previous cycles. The civic attitudes and 
engagement framework further includes a sub-structure that covers similar elements 
as the content domains in the civic knowledge framework, so that the new framework 
structure continues to allow investigating the connections of civic knowledge with 
attitudes and engagement. 

The new structure maintains a high degree of consistency across cycles, reflects 
contemporary research findings on civic and citizenship education among students 
at secondary school, is designed to address the needs and interests of participating 
countries, limits the framework’s scope to aspects that can be appropriately measured, 
encompasses relevant features that describe the breadth of contexts and outcomes of 
civic and citizenship education, and considers a wide range of diverse contexts for 
this learning area across participating countries. 

The ICCS 2022 assessment framework consists of four parts that follow this 
introduction: the civic knowledge framework (describing aspects to be addressed 
when measuring students’ civic knowledge and understanding), the civic attitudes 
and engagement framework (describing the affective-behavioral constructs to be 
measured), the contextual framework (outlining the relevant context factors measured 
through student, teacher, school, and national contexts questionnaires necessary to 
understand cognitive and affective-behavioral learning outcomes), and in Chap. 5 the 
Assessment Design (describing the coverage of framework domains, the different 
item types, the assessment design, features of computer-enhanced measurement used 
in the international option of a computer-based delivery, and the expected cognitive, 
affective-behavioral and contextual indices). The framework also includes appen- 
dices with information about staff and institutions involved in ICCS 2022, key terms 
related to the civic knowledge framework, information on the described levels of 
civic knowledge, and examples of ICCS 2022 test items. 
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Chapter 2 A) 
Civic Knowledge Framework get 


2.1 Framework Scope and Structure 


The ICCS test of civic knowledge and understanding is a central component of this 
study. To respond to test questions assessing students’ knowledge and understanding 
of civic-related issues, students need to apply distinct cognitive processes to civic 
and citizenship content. In the context of ICCS, civic knowledge has evolved as the 
term used to refer to demonstrable student achievement based on the application 
of the cognitive processes to content as measured by the ICCS test. In ICCS, the 
term civic knowledge encompasses student achievement that extends beyond their 
capacity to recall information and includes students’ ability to reason with and apply 
their knowledge. 

The content that underpins the measurement of student civic knowledge in ICCS 
2022, as in previous cycles, is organized according to four distinct content domains. 
To further support a complete representation of the cognitive aspects that underpin 
expressions of students’ civic knowledge, the ICCS 2022 assessment framework 
distinguishes between two cognitive domains that outline the types of cognitive 
processes applied by students’ when they respond to test items. 


2.2 Content Domains 


Content domains describe areas related to civic and citizenship education about 
which individuals may have developed knowledge and understanding. Each content 
domain is divided into subdomains, and each subdomain is related to a number of 
aspects that may overlap. 

The ICCS civic knowledge framework frequently uses a set of key terms that are 
either related across all content domains, or specifically related to particular content 
domains. While recognizing that many of them are the subject of ongoing dispute 
(see, for example, Koyama, 2017; Haste, 2010), the definitions of key terms (both 
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general and domain-specific) have been developed to support consistent understand- 
ings of the framework’s contents across the broad range of countries participating 
and interested in ICCS (see Appendix B for a list of relevant key terms). 

The four content domains are: 


I. Civic institutions and systems 
II. Civic principles 
Ill. Civic participation 

IV. Civic roles and identities 


The first content domain, civic institutions and systems, relates to the mecha- 
nisms, systems, and organizations that underpin societies. The second domain, civic 
principles, is concerned with shared ethical foundations of civic societies. Civic 
participation refers to the nature of the processes and practices defining and medi- 
ating the participation of citizens in their civic communities. ICCS recognizes the 
centrality of the individual citizen through the fourth content domain civic roles 
and identities. This domain refers to formal or informal civic roles, citizens and 
the individuals’ personal perception of being agents of civic action with connec- 
tions to multiple communities. Together, these four domains describe the civic and 
citizenship content that will be assessed with the ICCS 2022 civic knowledge test. 

It is important to emphasize that the content domains in ICCS do not presuppose an 
analytic structure. Across previous cycles of ICCS, civic knowledge has been reported 
as a single dimension (Schulz et al., 2010, 2018). The presentation of content across 
four domains is primarily intended to organize the content thematically in a way that 
is coherent with civic and citizenship curriculums, reinforce the content validity of 
the instruments, and make the framework content accessible to readers. With that 
in mind, the thematic differences across the four content domains may provide an 
analytic framework for further secondary analyses of students’ civic knowledge and 
will also be reviewed with ICCS 2022 main survey data. 

The four content domains were originally defined in the ICCS 2009 assessment 
framework (Schulz et al., 2008) and retained with minor modifications in ICCS 2016 
(Schulz et al., 2016). All content domains were retained in substance but with some 
modifications for ICCS 2022. While in the first two cycles aspects of individuals’ 
roles as citizens were described as part of the first content domain (previously called, 
civic society and systems), they are now incorporated into the fourth content domain 
(now called civic roles and identities). The content domain civic institutions and 
systems now includes economic systems as an additional subdomain. In the content 
domain civic principles, the subdomain sense of community was substituted with 
the content domain solidarity, while sustainability was added as another subdomain. 
In comparison with the ICCS 2009 and ICCS 2016 frameworks, this framework 
also includes more explicit references to content associated with global citizenship 
education and education for sustainable development. It is important to note that 
while structural changes were introduced in ICCS 2022, all civic knowledge aspects 
present in the previous assessment frameworks continue to be included. 
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2.2.1 Civic Institutions and Systems 


The content domain, civic institutions and systems, focuses on the formal and 
informal mechanisms and organizations that underpin the functioning of the societies. 
The three subdomains of civic institutions and systems are: 


I. State institutions 
II. Economic systems 
HI. Civil society 


State institutions 


The subdomain, state institutions, focuses on those institutions central to the 
processes and enacting of civic governance and legislation in the common interest 
of the people they represent and serve. 

Aspects related to this subdomain include: 


Legislatures/parliaments 

Governments 

Supranational/intergovernmental governance bodies 
Judiciaries 

Law enforcement bodies 

National defense forces 

Public service providers 

Electoral commissions 


Economic systems 


The subdomain, economic systems, focuses on institutions, players, structures, 
mechanisms, and relationships that are relevant to the economy. 
Aspects related to this subdomain include: 


Economic structures, mechanisms, and conditions 
Economic interest groups (e.g., chambers of commerce) 
Companies/corporations 

Financial institutions (national and supranational) 
Tariffs and trade relations between countries 

Taxation 


Civil society 


The subdomain, civil society, focuses on those institutions that can mediate citizens’ 
contact with their state institutions and allow citizens to actively pursue many of their 
roles in their societies. 

Aspects related to this subdomain include: 


e Trade unions 
e Political parties 
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e Non-governmental organizations (NGOs) 
e Advocacy groups (for example, pressure, lobby, campaign, special interest groups) 
e Traditional media (for example, newspaper, television, and radio) 
e New media (for example, web forums, blogs, Twitter, Instagram, Facebook, and 
podcasts) 
e Religious institutions 
Schools 


Cultural organizations 


2.2.2 Civic Principles 


The content domain, civic principles, focuses on the shared ethical foundations of 
civic societies. The framework regards support, protection, and promotion of these 
principles as civic responsibilities and as frequently occurring motivations for civic 
participation by individuals and groups. The domain consists of five subdomains: 


I. Equity 

Il. Freedom 
MI. Rule of law 
IV. Sustainability 
V. Solidarity 


Equity 


The subdomain, equity, focuses on the principle that all people have the right to fair 
and just treatment, and that protecting and promoting equity is essential to achieving 
peace, harmony, and productivity within and among communities. The principle of 
equity is derived from the notion of equality—that “all people are born equal in terms 
of dignity and rights” (United Nations, 1948). 

Aspects related to this subdomain include: 


e Equal opportunities 
e Equal rights 
e Inequalities across and within societies 


Freedom 


The subdomain, freedom, focuses on the concept that all people should have funda- 
mental freedoms, as articulated in the United Nations Universal Declaration of 
Human Rights (United Nations, 1948). Societies have a responsibility to actively 
protect the freedom of their members and to support the protection of freedom in all 
communities, including those that are not their own. However, there are situations 
where certain freedoms might have to be restricted when they conflict with others 
(e.g., to prevent hate speech aimed at the incitement of hatred toward others) or 
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when this is necessary to preserve the safety of society as a whole (e.g., in national 
emergencies such as the COVID-19 pandemic). 
Aspects related to this subdomain include: 


Freedom of opinion and expression 

Freedom of movement and residence 
Freedom of thought, conscience, and religion 
Freedom of peaceful assembly and association 
Freedom from fear 

Freedom from want 


Rule of Law 


The subdomain, rule of law, is related to the principle of governance that all persons, 
institutions, and entities (public or private and including the State itself) are subject 
and accountable to laws, which are publicly promulgated, independently adjudicated, 
equally enforced, and consistent with international standards and norms protecting 
human rights. It furthermore requires the establishment of “measures to ensure adher- 
ence to the principles of supremacy of the law, equality before the law, accountability 
to the law, fairness in the application of the law, separation of powers, participation 
in decision-making, legal certainty, avoidance of arbitrariness, and procedural and 
legal transparency” (United Nations, 1948, 2004). 
Aspects related to this subdomain include: 


Recognition of the supremacy of law 

Equality before the law regardless of their background and personal characteristics 
(such as gender, race, religion, authority, or social status) 

Fairness in the application of law 

Separation of powers 

Mechanisms and institutions for challenging existing laws 

Participation in decision-making 

Legal certainty 

Legal and procedural transparency 


Sustainability 


The subdomain, sustainability, is related to the principle that human development 
meets the needs of the present without compromising the ability of future generations 
to meet their own needs (see Schulz et al., 2016; United Nations, 1987). The principle 
of sustainability requires both collective and individual activities to make human 
development more sustainable. 

Aspects of sustainability include: 


è Environmental sustainability as a “state in which the demands placed on the 
natural world can be met without negatively impacting on the natural world or 
reducing its capacity to support human life” (Schulz et al., 2016, p. 18). 


32 2 Civic Knowledge Framework 


e Social sustainability as a state in which current social practices, processes and 
systems support the capacity for future generations to have the same or greater 
access to social resources than the current generation to ensure human survival 
and promote the well-being of all human beings. 

e Economic sustainability as a state in which an economy can support a defined 
level of economic production indefinitely through responsible consumption and 
production so that it can meet future demands in a sustainable way.! 


Solidarity 


The subdomain, solidarity, reflects the notion that individuals or groups show support 
for each other. Solidarity is an expression of social cohesion based upon the inter- 
dependence which people have on each other and is a civic principle that is related 
to their sense of belonging and connectedness within societies.” Expressions of soli- 
darity between members and groups in society tend to vary considerably across 
different national contexts (e.g., in terms of support provided to people in need). The 
notion of transnational solidarity is also of importance in this context and relates to 
the degree to which members of a national society develop recognition for support of 
those in other countries (see, for example, Domerath, 2012). It is important to note 
that there are also negative forms of solidarity, as, for example, when solidarity is 
promoted only within particular groups in the population at the expense of others. 
Aspects related to this subdomain include: 


Social welfare 

Charity 

Mutual aid or support 
Transnational aid or support 


2.2.3 Civic Participation 


The content domain, civic participation, refers to the manifestations of individuals’ 
actions in their communities. Civic participation can operate at any level of commu- 
nity and in any community context (including schools as the imminent context for 
the age group under study). The level of participation can range from awareness to 
engagement through to influence. The three subdomains of civic participation are: 


I. Decision-making 
Il. Influencing 
HI. Community participation 


l In ICCS, primarily because of the focus on students in grade 8, economic sustainability is covered 
in less explicit detail than environmental sustainability and social sustainability. 

? Durkheim (1969) distinguished between mechanical solidarity, based on structural links like group 
membership or mutual dependence, and organic solidarity, reflecting a more individualistic form of 
solidarity related to the identification with a larger and more diverse collective as well as empathic 
views of others in society (see also Honneth, 1996; Thijssen, 2012). 
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Decision-making 


The subdomain, decision-making, focuses on active participation that directly results 
in the implementation of policy or practice regarding the individual’s community or 
a group within that community. Aspects of this subdomain include: 


e Engaging in organizational governance 
e Voting 


Influencing 


The subdomain, influencing, focuses on actions aimed at informing and affecting 
any or all of the policies, practices, and attitudes of others or groups of others in the 
individual’s community. Aspects of this subdomain include: 


Engaging in public debate (including participation through social media) 
Engaging in demonstrations of public support or protest (including “virtual” 
engagement through the use of, for example, online petitions) 
Engaging in policy development 
Developing proposals for action or advocacy 
Selective purchasing of products according to ethical beliefs about the way they 
were produced (ethical consumption/ethical consumerism) 

e Recognizing corruption 


Community participation 


The subdomain, community participation, focuses on participation, with a primary 
focus on enhancing a person’s connections with a community, for the ultimate benefit 
of that community. Aspects of this subdomain include: 


Volunteering 
Participating in cultural, community or interest-based organizations (including 
virtual/online communities) 

e Acquisition of information (through traditional media, social media, internet sites 
or personal communication) 


2.2.4 Civic Roles and Identities 


The content domain, civic roles and identities, refers to knowledge and understanding 
of the individual’s civic roles and identities, and their perceptions of these roles 
and identities. Civic roles and identities include those that are related to concepts 
of nation, ethnic origin, and cultural heritage. ICCS assumes that individuals both 
influence and are influenced by the relationships they have with family, peers, and 
civic communities. Thus, an individual’s civic identity explicitly links to a range 
of personal and civic interrelationships. This framework asserts and assumes that 
individuals may have multiple articulated identities rather than a single civic identity. 
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Civic communities include points of reference at many levels, ranging from family 
and local community to geographical regions or the global community. Furthermore, 
communities can be based on specific topics (such as sports or common interests) or 
even be formed through the use of digital technologies. 

The content domain civic roles and identities comprises three subdomains: 


I. Citizens 
II. Civic self-image 
HI. Civic connectedness 


Citizens 


The subdomain, citizens, focuses on students’ knowledge and understanding of 
formal and informal aspects of the civic relationships between individuals and their 
societies. 

Aspects related to this subdomain include: 


e Citizens’ roles within their civic society 
© Citizens’ responsibilities within their civic society 
e Citizens’ opportunities to engage within their civic society (e.g., voting rights) 


Civic self-image 


The subdomain, civic self-image, refers to students’ recognition of the differences 
in experience individuals may have regarding their place within and across different 
civic communities. Civic self-image focuses on individuals’ knowledge and under- 
standing of their civic and citizenship values, their management of these values, and 
the extent to which these values can be in harmony or in conflict when individuals 
engage with their various civic communities. Civic communities may range from 
local groups to the global community, and may also consist of virtual communities 
(e.g., defined by those that are digitally supported). 
Aspects related to this subdomain include: 


Global citizenship identity 

Supra-national identity 

National identity 

Cultural identity 

Ethnic identity 

Gender identity 

Religious identity 

Identifying with communities (local, interest-based, virtual) 


Civic connectedness 


The subdomain, civic connectedness, refers to students’ recognition of the sense 
of connection individuals may have regarding different civic communities. It also 
refers to a recognition of the communities’ individuals may feel connected to that 
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may vary substantially and include global as well as virtual (e.g., digitally defined) 
communities. 

Civic connectedness also includes students’ recognition and understanding of the 
definition and role of tolerance toward diversity (of civic ideas and actions) within and 
across their communities, and their recognition and understanding of the effects that 
different civic and citizenship values and belief systems across different communities 
may have on members of those communities. 

Aspects related to this subdomain include: 


e Acceptance of, respect for, and appreciation of difference (sometimes also referred 
to as tolerance) 
Global awareness 
Sense of community 
Social cohesion 


2.3 Cognitive Domains 


Each of the four content domains encompasses different types of knowledge 
concerned with civic and citizenship issues (factual, procedural, conceptual, and 
meta-cognitive). The civic knowledge framework considers the extent to which 
students develop the capacity to process the content of the four domains and reach 
conclusions that are broader than any single piece of knowledge. This includes the 
processes involved in understanding complex sets of factors influencing civic actions 
and planning for and evaluating strategic solutions and outcomes. The scope of civic 
knowledge as conceptualized for ICCS is not limited to direct applications of knowl- 
edge that reach conclusions about concrete situations. It also includes the selection 
and assimilation of knowledge, as well as the understanding of multiple concepts, so 
that conclusions about complex, multifaceted, unfamiliar, and abstract situations can 
be reached. To capture these distinct features of cognitive knowledge, ICCS 2022 
distinguishes remembering or recalling information or processing content in terms 
of understanding from applying an understanding to new situations. 

When responding to the ICCS 2022 civic knowledge test, students need to know 
the civic and citizenship content that is assessed. They also need to be able to apply 
more complex cognitive processing to their civic and citizenship knowledge and to 
relate their knowledge and understandings to real-world civic action. Consequently, 
two cognitive domains are observable, the first, knowing, outlines the types of civic 
and citizenship information that students are required to demonstrate knowledge of. 
The second domain, reasoning and applying, details the cognitive processes that 
students require to reach conclusions and to translate their knowledge into civic 


3 This classification is a simplified version of the hierarchy of cognitive processes articulated by 
Anderson and Krathwohl (2001). The simplification is intended to reflect what is appropriate for 
students in the target grade and what is most relevant to studying their knowledge of civic and 
citizenship issues. 
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actions. Similar definitions of cognitive domains can be found in the mathematics 
and science frameworks for TIMSS (see Mullis and Martin, 2013, 2017). 


2.3.1 Knowing 


The cognitive domain, knowing, refers to the learned civic and citizenship informa- 
tion that students use when engaging in the more complex cognitive tasks that help 
them make sense of their civic worlds. Students are expected to remember, recall or 
recognize definitions, descriptions, and the key properties of civic and citizenship 
concepts and content, and to illustrate these with examples. Due to the nature of ICCS 
as an international study, the concrete and abstract concepts students are expected 
to know in the core cognitive assessment are those that can be generalized across 
societies. 
The cognitive domain, knowing, relates to the following cognitive processes: 


e Defining: Respondents are able to identify statements that directly define civic 
and citizenship concepts and content. 

è Describing: Respondents are able to identify statements that directly describe the 
key characteristics of civic and citizenship concepts and content. 

e Illustrating with examples: Respondents are able to identify examples that directly 
support or clarify statements about civic and citizenship concepts and content. 


2.3.2 Reasoning and Applying 


The cognitive domain, reasoning and applying, refers to the ways in which students 
use civic and citizenship information to reach conclusions that are broader than 
the contents of any single concept and to make use of these in real-world contexts. 
Reasoning and applying includes, for example: the use of knowledge to reach conclu- 
sions about familiar concrete situations; the selection and assimilation of knowledge 
and understanding of multiple concepts; the evaluation of proposed and enacted 
courses of action; providing recommendations for solutions or courses of action. 

The cognitive domain, reasoning and applying, relates to the following cognitive 
processes: 


e Interpreting information: Respondents are able to identify statements about infor- 
mation presented in textual, graphical, and/or tabular form that make sense of the 
information in the light of a civic and citizenship concept. 

e Relating: Respondents are able to use the key defining aspects of a civic and 
citizenship concept to explain or recognize how an example illustrates a concept. 

e Justifying: Respondents are able to use evidence and civic and citizenship concepts 
to construct or recognize a reasoned argument to support a point of view. 
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e Integrating: Respondents are able to identify connections between different 
concepts across themes and across civic and citizenship content domains. 

© Generalizing: Respondents are able to identify civic and citizenship conceptual 
principles manifested as specific examples and explain how these may apply in 
other civic and citizenship contexts. 

e Evaluating: Respondents are able to identify judgments about the advantages and 
disadvantages of alternative points of view or approaches to civic and citizenship 
concepts and actions. 

© Suggesting solutions: Respondents are able to identify courses of action or thought 
that can be used to alleviate civic and citizenship problems expressed as conflict, 
tension, and/or unresolved or contested ideas. 

e Predicting: Respondents are able to identify likely outcomes of given civic and 
citizenship policies strategies and/or actions. 
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Chapter 3 A) 
Civic Attitudes and Engagement get 
Framework 


3.1 Framework Scope and Structure 


Similar to previous IEA studies of civic and citizenship education, ICCS places 
great emphasis on the measurement of affective-behavioral aspects with student 
questionnaire items. These measures are regarded as important learning outcomes 
and have a similar standing in the process of development, analysis, and reporting 
as cognitive measures of students’ civic knowledge. Student attitudes, perceptions, 
and behaviors relevant to civic and citizenship issues are organized according to two 
affective-behavioral areas which are elaborated in the sections which follow: 


Affective-behavioral area 1: Attitudes (e.g., judgements in relation to ideas, 
people, objects, events or situations) 

Affective-behavioral area 2: Engagement (e.g., interest in, and expectations of, 
civic engagement through civic action and future political participation) 


Aspects relating to these domains are measured with the international or regional 
ICCS 2022 student questionnaires using items that do not require correct or incor- 
rect responses (typically with Likert-type item format), indicating for example the 
extent to which respondents agree or disagree with a given statement. While most 
constructs or aspects are measured as an integral part of the international student 
questionnaire, others are included as international options or in the regional student 
questionnaires for Europe and Latin America. It should be noted that, the inclusion of 
topics in regional instruments was determined by region-specific interests expressed 
by countries in each geographic region and does not mean that they are deemed as 
unimportant in other countries. 
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3.2 Attitudes 


The affective-behavioral area, attitudes, refers to judgements or evaluations regarding 
ideas, persons, objects, events, situations, and/or relationships. It is possible for 
individuals to harbor contradictory attitudes at the same time. Attitudes encompass 
perceptions that are focused on specifics and can change over time, as well as those 
reflecting broader and more fundamental (or deeply rooted) beliefs (about values)! 
that tend to be constant over longer periods of time. Attitudes include attitudes toward 
civic principles, perceptions of civic issues and institutions, and perceptions of civic 
roles and identities. 

Constructs and measures reflecting students’ attitudes are described with regard 
to the following subareas, which cover similar aspects as three of the four content 
domains in Chap. 2 (i.e., civic principles, civic institutions and systems, and civic 
roles and identities): 


e Attitudes toward civic principles: examples include attitudes toward gender 
equality, attitudes toward diversity, and attitudes toward sustainable development. 

© Attitudes toward civic issues and institutions: examples include trust in institu- 
tions, and perceptions of threats to the world’s future. 

© Attitudes toward civic roles and identities: examples include perceptions of good 
citizenship behavior, European identity, and expectations about one’s individual 
future. 


3.2.1 Attitudes Toward Civic Principles 


The following constructs reflecting student attitudes toward civic principles are 
measured as part of the international student questionnaire and the regional European 
and the Latin American questionnaires in ICCS 2022: 


e Students’ perceptions of threats to democracy (international student question- 
naire) 
Students’ attitudes toward gender equality (international student questionnaire) 
Students’ attitudes toward equal rights for immigrants and non-immigrants 
(international student questionnaire) 

e Students’ attitudes toward environmental sustainability (international student 
questionnaire) 

e Students’ attitudes toward equal rights for all ethnic groups in society (interna- 
tional student questionnaire, optional) 


'ICCS 2009 distinguished “value beliefs” from “attitudes” but since ICCS 2016 the affective- 
behavioral area attitudes encompasses both types of beliefs. This change was implemented to address 
concerns about the possibility to clearly distinguish more enduring and deeply-rooted beliefs from 
those that are more focused on specific issues and more time-specific in a study of adolescents in 
this relatively young age group. 
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e Students’ perceptions of discrimination (European and Latin American student 
questionnaires) 

e Students’ attitudes toward freedom of movement for European citizens within 
Europe (European student questionnaire) 

e Students’ attitudes toward corrupt practices (Latin American student question- 
naire) 

e Students’ attitudes toward disobedience to the law (Latin American student 
questionnaire) 

e Students’ attitudes toward homosexuality (Latin American student questionnaire) 


Students’ perceptions of threats to democracy: In the IEA CIVED survey in 1999, 
students were asked to rate a number of characteristics of society as either “good or 
bad for democracy” (see Torney-Purta et al., 2001). ICCS 2009 used a set of nine 
items that measured the extent of student agreement as to what a society should be 
like, using a set of items that were adapted from a subset of those included in CIVED. 
Most of these items were endorsed by very large majorities of students across all 
participating countries (Schulz et al., 2010). In ICCS 2016, students’ attitudes toward 
democratic values were assessed using a different format that requires students to 
rate a number of possible characteristics of a society as “good”, “bad” or “neither 
good nor bad” for democracy, and results showed considerable variations across 
countries (Schulz et al., 2018b). For ICCS 2022, students are asked about their 
perceptions of the extent to which different possible situations in society would be 
bad for democracy. 

Students’ attitudes toward gender equality: Gathering data about attitudes toward 
women’s rights was part of the IEA civic education studies in 1971 and 1999 
(Torney et al., 1975; Torney-Purta et al., 2001). ICCS 2009 measured the endorse- 
ment of gender equality and showed that large majorities agreed with the positive, 
and disagreed with the negative, statements about gender equality (Schulz et al., 
2010). Support for gender equality was associated with student characteristics, and 
female students expressed more support for gender equality than males (Sandoval 
et al., 2018). ICCS 2016 results, making use of the same item set as in the previous 
cycle, showed increased endorsement of gender equality in some countries as well as 
persisting differences across participating countries (Schulz & Ainley, 2018; Schulz 
et al., 2018). ICCS 2022 assesses students’ attitudes toward gender equality with 
a slightly modified set of items. While these studies have traditionally considered 
gender equality between women and men, conceptualizations of gender have evolved 
beyond this binary view of gender. Consequently, we expect that a broader conceptu- 
alization of gender, which recognizes individual gender self-determination including 
non-binary conceptualizations, will underpin the measurement of students’ attitudes 
towards gender identity in future cycles of ICCS. 

Students’ attitudes toward the rights of immigrants: The assessment of beliefs 
about the rights for immigrants has been a focus of research in recent years (Heath & 
Richards, 2016; Masso, 2009; Paas & Halapuu, 2012; Rustenbach, 2010). Using 
similar item sets as in CIVED 1999 (Torney-Purta et al., 2001), ICCS 2009 measured 
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endorsement of rights for immigrants and found that majorities among lower- 
secondary students tended to be overwhelmingly in favor of equal rights for immi- 
grants (Schulz et al., 2010). However, support was associated with student character- 
istics and female and immigrant students had more positive attitudes (Munck et al., 
2018; Sandoval et al., 2018; Schulz et al., 2010). Based on the same set of items 
in its regional European questionnaire, [CCS 2016 showed similar levels of support 
across European countries as in the first ICCS cycle (Losito et al., 2018). Given the 
increased importance of immigration also in many non-European countries (e.g., as 
a consequence of the recent refugee crises in Latin America), ICCS 2022 measures 
these attitudes as part of the international student questionnaire. 

Students’ attitudes toward equal rights for all ethnic groups in society: This 
construct reflects students’ beliefs about equal rights for all ethnic groups in a 
country. Using similar items as in CIVED 1999 (Torney-Purta et al., 2001), ICCS 
2009 measured this construct with statements reflecting attitudes toward equal rights 
for all ethnic groups, and results showed typically high levels of agreements as well 
as variations across and within countries (Sandoval et al., 2018; Schulz et al., 2010). 
ICCS 2016 used the same set of items to measure this construct and found that support 
for equal rights had significantly increased in most countries that had participated in 
the first two cycles of this study (Schulz, 2018; Schulz & Ainley, 2018; Schulz et al., 
2018b). ICCS 2022 continues to assess young people’s attitudes toward equal rights 
for all ethnic/racial groups in society with an optional question in the international 
student questionnaire. 

Students’ perceptions of discrimination: Discrimination based on personal and/or 
group characteristics is perceived as a persisting issue across many societies. In 
European contexts, adult surveys have shown perceptions of quite high levels of 
discrimination, in particular regarding ethnic origin (European Commission, 201 2a). 
However, there is evidence that people from European countries with more effec- 
tive antidiscrimination laws tend to be more knowledgeable about rights regarding 
discrimination (Ziller, 2014). Opinion surveys among adults also highlighted that 
across Latin American countries there are high levels of perceived discrimination, 
regarding poor people, members of indigenous communities, and people of African 
descent (Chong & Nopo, 2007; Nopo et al., 2010), and perceptions of discrimina- 
tion were associated with individual background (skin color and ethnicity) as well as 
contextual factors (Canache et al., 2014). The ICCS 2022 regional questionnaires for 
European and Latin American countries include sets of items measuring the extent 
to which students perceive specific social groups as discriminated in their countries. 

Students’ attitudes toward freedom of movement for European citizens within 
Europe: Freedom of movement for European citizens across EU member countries 
was an essential part of the Lisbon Strategy (European Council, 2000).” There is 


2 A recent survey showed that nearly 70% of respondents considered the Schengen Area as one of the 
EU’s main achievements, and half of them considered easier trade and travel and absence of passport 
control as two of its most positive aspects (European Commission, 2018c). EU member countries 
tend to have the highest share of free-movement flows in total permanent migration movements 
(OECD, 2012) and recent statistics also showed that employments rates are higher among EU 
mobile citizens (EUROSTAT, 2018). 
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evidence that cross-border mobility leads to a stronger identification with Europe, 
positive attitudes toward the EU and specific visions of the EU, all of which also 
contribute to increased EU-related engagement (Mazzoni et al., 2017) even though 
challenges remain regarding the monitoring of movement of all individuals (Carrera, 
2005). The European student questionnaire in ICCS 2009 measured students’ atti- 
tudes toward freedom of movement using positive and negative statements about 
the freedom of movement between EU countries for European citizens. Analyses of 
data based on these statements suggested the presence of two constructs reflecting 
support of freedom of movement and preferences for restrictions, respectively. 
Results showed overwhelming student support for the benefits of free movement, 
as well as substantial proportions in favor of restricting the movement of workers 
across borders (see Kerr et al., 2010). The ICCS 2016 European student question- 
naire included a similar item set and results showed that majorities among students 
endorsed this principle (Losito et al., 2018). The topic of free movement within 
the EU continues to be of high relevance in public debate and ICCS 2022 assesses 
this construct with a modified item set to measure students’ perceptions regarding 
freedom of movement. 

Students’ attitudes toward corrupt practices? (included in the Latin American 
questionnaire): Corruption is widely regarded as one of Latin America’s most salient 
problems and, with few exceptions, countries in this region tend to have low indices 
of transparency in cross-national surveys as well as higher levels of acceptance of 
corrupt practices (Torgler & Valev, 2006; Transparency International, 2019). Citi- 
zens’ perceptions of the level of corruption have also been found to be related to lower 
levels of trust in institutions (Morris & Klesner, 2010; Riccucci, 2014) and large 
proportions of Latin American citizens reported personal experiences with corrupt 
practices (Morris & Blake, 2010). In its Latin American student questionnaire, ICCS 
2009 and 2016, measured young people’s attitudes toward corrupt practices, and 
results showed an acceptance of corrupt practices by many, albeit not by a majority 
of students (Schulz et al., 2011, 2018a). ICCS 2022 continues to assess this construct 
with a slightly reduced set of items. 

Students’ attitudes toward disobedience to the law (included in the Latin American 
questionnaire): Cross-national adult surveys in Latin American countries have shown 
a high level of ambiguity regarding civic morality (i.e., moral behavior and accepting 
civil disobedience), with some countries of the region recording high proportions 
of acceptance in regard to law-breaking (Letki, 2006), particularly amongst young 
people (Torgler & Valev, 2006). The Latin American student questionnaires in ICCS 
2009 and 2016 included items measuring students’ acceptance of breaking the law 
under different circumstances, and results from both surveys showed that larger 
proportions of young people in the participating countries endorsed civil disobe- 
diences, in particular, in cases where it was perceived as the only way to achieve 
things, help the family, or when it was done without bad intentions (Schulz et al., 


3 The attitude items concerned with corrupt practices, disobedience to the law, and homosexuality 
were included in the Latin American student questionnaire as a result of consultations about civic 
issues with participating countries during the development of ICCS 2009. 
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2011, 2018a). The Latin American student questionnaire in ICCS 2022 includes an 
unmodified item set to measure comparisons over time. 

Students’ attitudes toward homosexuality (included in the Latin American ques- 
tionnaire): In the past, survey data from the Latin American region suggested consid- 
erable differences across countries within the region and a divided public opinion 
regarding attitudes toward homosexuality (Latinobarómetro, 2009; Pew Research 
Center, 2014a). Research has shown that attitudes towards homosexuality in the 
region are often associated with age, gender, socioeconomic background, educa- 
tion, and religious beliefs (Kelley, 2001; Navarro et al., 2019; Pew Research Center, 
2014b). In both ICCS 2009 and 2016, the Latin American regional questionnaires 
included items asking students about their agreement with statements about homo- 
sexuality. In accordance with previous survey research among adults, the results 
showed considerable variation in attitudes across the participating countries. Support 
for legalization of gay marriage increased between 2009 and 2016 in Chile, Colombia 
and Mexico where large majorities among students endorsed this position (Schulz 
etal., 2011, 2018a). The regional instrument for Latin America in ICCS 2022 includes 
the same set of items measuring students’ attitudes toward homosexuality which was 
used in ICCS 2016. 


3.2.2 Attitudes Toward Civic Issues and Institutions 


The following constructs reflecting student attitudes toward civic issues and insti- 
tutions are measured using the international student questionnaire and the regional 
European and Latin American questionnaires in ICCS 2022: 


e Students’ perceptions of student participation at their schools (international 
student questionnaire); 

e Students’ attitudes toward the political system (international student question- 
naires); 

e Students’ acceptance of restrictions during a national emergency (international 
student questionnaire); 
Students’ trust in institutions (international student questionnaire); 
Students’ perceptions of threats to the world’s future (international student 
questionnaire); 

e Students’ attitudes toward the influence of religion in society (international student 
questionnaire, optional); 
Students’ expectations of the future of Europe (European student questionnaire); 
Students’ attitudes toward cooperation among European countries (European 
student questionnaire); 
Students’ attitudes toward the European Union (European student questionnaire); 
Students’ attitudes toward authoritarian government practices (Latin American 
student questionnaire). 
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Students’ perceptions of student participation at their school: Adolescents are 
mostly not yet able to vote or run for office in “adult politics,” but they experiment as 
students to determine what degree of power they have to influence the ways schools 
are run (Bandura, 1997). As in CIVED 1999 (Torney-Purta et al., 2001), ICCS 
2009 and 2016 assessed students’ attitudes toward the value of student participation 
in civic-related activities at school. Results showed high levels of student support 
for the value of participating at their schools and that females tended to be more 
supportive of participation than male students (Schulz et al., 2010, 2018b). ICCS 
2022 continues to measure aspects related to this topic, with a modified item set 
focusing on perceptions of the value of student participation at their schools. 

Students’ attitudes toward the political system: Recent years have witnessed 
signs of increasing political instability in many societies, amongst them even long- 
established democracies (Diamond, 2015, 2021; Mair, 2002). More voters have been 
reported to have abandoned their loyalties to established political parties and are 
turning to populist parties or candidates (Boogards, 2017). Frequently, these develop- 
ments have been linked to the increased alienation of citizens from civic institutions, 
in particular, from traditional political parties, increasing economic inequalities, and 
as a response to growing globalization and migration (Hobolt et al., 2016). Across 
different countries, supporters of populist candidates, movements, and parties tend 
to support democracy as well as to express dissatisfaction with its implementation, 
however, there is also evidence of cross-national differences in the sociodemographic 
profiles and political features (Rovira Kaltwasser & Van Hauwaert, 2020). In partic- 
ular in the Latin American region, the role of social movements has been emphasized 
in its importance for mobilizing citizens in support for social change (Donoso, 2017). 
For ICCS 2022, the student questionnaire asks about students’ agreement or disagree- 
ment with different statements related to the political system, its institutions, and its 
representatives, encompassing both positive and negative perceptions. 

Student acceptance of restrictions during a national emergency: The outbreak 
of the COVID-19 pandemic in early 2020 became an unprecedented challenge to 
democratic governance in terms of a wide range of restrictions placed on individual 
freedom and the suspension of citizen rights and democratic processes (Marzocchi, 
2020; Landman & Di Gennaro Splendore, 2020). There is also evidence that it 
affected public perceptions of government and society (Krastev & Leonard, 2020). 
To assess the views of young people regarding these issues, ICCS 2022 includes a 
question about students’ acceptance of restrictions imposed by governments during 
a national emergency. 

Students’ trust in institutions: As in earlier IEA studies of civic and citizenship 
education (Torney et al., 1975; Torney-Purta et al., 2001), ICCS asked students about 
their trust in a range of institutions. Across countries, results from 2009 showed that 
students tended to express the lowest levels of trust in political parties and the highest 
levels of trust in courts of justice (Schulz et al., 2010). Furthermore, in countries 
with relatively high levels of perceived corruption, and low scores on indices of 
government efficiency, students with higher levels of civic knowledge expressed 
less trust in civic institutions, while positive correlations between civic knowledge 
and trust were recorded in countries with low indices of corruption (Lauglo, 2013). 
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Results from the second ICCS cycle found, in several countries, increases in trust 
in institutions (Schulz et al., 2018b). ICCS 2022 continues to assess students’ trust 
in groups and institutions with a largely unmodified item set, which will allow the 
measurement of changes over time. Furthermore, it includes two new additional 
items reflecting trust in scientists and the students’ teachers. 

Students’ perceptions of threats to the world’s future: It has been reported that 
students express concern about global issues including those regarding poverty, 
hunger, wars, overpopulation, and the environment (Holden, 2007; Oscarsson, 1996; 
Rubin, 2002). In ICCS 2016, students were asked to rate the seriousness of a broad 
range of threats to key aspects of civilization. More than half the students considered 
pollution, terrorism, water shortages, food shortages, infectious diseases, climate 
change, and poverty as threats to the world’s future. These aspects are also reflected 
in writings concerned with global education that aim to broaden student perspec- 
tives beyond national contexts (Burnouf, 2004; Hicks, 2003). Overall, these ratings 
provide an indication of student optimism or pessimism, and responses to individual 
items provide a perspective on profiles of concern. Results from ICCS 2016 showed 
that concerns about these issues tended to be influenced by local contexts in partici- 
pating countries (Schulz et al., 2018b). The ICCS 2022 student questionnaire uses a 
slightly revised set of items but will allow measuring perceptions over time for some 
of the issues, including those related to threats due to infectious diseases (such as 
COVID-19) and climate change. 

Students’ attitudes toward the influence of religion in society: There is evidence 
about associations between religious beliefs and attitudes toward social issues (van 
der Toorn et al., 2017), and it has also been identified as an important catalyst of 
civic participation (see Ekström & Kwalem, 2013; Guo et al., 2013; Pancer, 2015; 
Putnam & Campbell, 2010; Storm, 2015; Verba et al., 1995). However, comparative 
research has also indicated that while political engagement is positively associated 
with active engagement in religious organizations, religiosity in itself can also be 
a deterrent for political action (Omelicheva & Achmed, 2018). Results from an 
international option for ICCS 2009 and 2016 showed that most students did not 
endorse religious influence on society, and that endorsement was higher among those 
with lower levels of civic knowledge and higher levels of attendance of religious 
services (Schulz et al., 2010, 2018b). ICCS 2022 continues to measure students’ 
attitudes toward religious influence as part of an international option within the 
international student questionnaire. 

Students’ expectations of the future of Europe: Recent opinion surveys among 
European citizens have shown that majorities expect that their children’s life will be 
more difficult than their own (European Commission, 2014). Further, adult citizens 
expected Europe’s influence to be stronger in comparison with countries like Brazil, 
India, and Japan but also weaker when compared with the influence of China or the 
United States (European Commission, 2018a). The ICCS 2016 European student 
questionnaire contained a question with possible scenarios for the European future, 
and students tended to be most concerned about increased terrorism and the influ- 
ence of non-European powers (Losito et al., 2018). ICCS 2022 continues to assess 
perceptions of European future with a modified item set. 


3.2 Attitudes 47 


Students’ attitudes toward cooperation among European countries: Recent 
opinion polls have indicated that, despite a general surge in anti-European sentiment 
in some member countries, majorities among European citizens support decision- 
making about important issues at the European level, especially in relation to migra- 
tion and refugees, fighting terrorism, security and defense policy, energy policy, and 
the environment (European Commission, 2018a). In addition to this, results from the 
Standard Eurobarometer survey showed that European citizens consider immigration 
as one of the major challenges that the EU is currently facing (European Commis- 
sion, 2018b). The European student questionnaire in ICCS 2009 included a question 
measuring students’ perception of harmonization in the European context, and results 
showed high levels of agreement with common European policies (Kerr et al., 2010). 
The European ICCS 2016 student questionnaire included a question measuring 
students’ endorsement of cooperation between European countries regarding a range 
of different issues, and most students tended to be supportive of European coopera- 
tion (Losito et al., 2018). The ICCS 2022 European student questionnaire continues 
to ask about views on European cooperation. Furthermore, the instrument includes 
an additional question asking students about their views on European cooperation in 
relation to environmental issues. 

Students’ attitudes toward the European Union: According to recent opinion 
surveys, majorities among Europeans perceived the EU as a safe place in a trou- 
bled world (European Commission, 2018a), and associated the EU with possibilities 
to travel, study, and work anywhere with the Euro as a common currency and with 
lasting peace (European Commission, 2018b). The European regional survey of ICCS 
2009 showed that support for the establishment of centralized European institutions 
was not particularly strong, and that support for further enlargement varied consid- 
erably across participating countries (see Kerr et al., 2010). The European student 
questionnaire for ICCS 2016 included a question containing statements about the 
EU, and the surveyed lower-secondary students tended to express positive attitudes 
toward the EU (Losito et al., 2018). Attitudes toward the EU continue to be of interest 
and are part of ICCS 2022 and will be measured through an item set in the European 
student questionnaire, which combines items from the previous survey with newly 
developed ones. 

Students’ attitudes toward authoritarian government practices in Latin America: 
Surveys in the Latin American region have shown considerable support for author- 
itarian government practices among adults and adolescents, and majorities among 
adult citizens supported non-democratic governments if they solved economic prob- 
lems (United Nations Development Programme, 2004) and that support for non- 
democratic government was lowest among more educated citizens (Cox, 2010). The 
Latin American student questionnaire, in ICCS 2009, included items measuring the 
endorsement of authoritarian government practices and the justification of dictator- 
ships (see Schulz et al., 2011). Results showed that considerable proportions of lower 
secondary students in all participating countries showed support for non-democratic 
government practices, and that majorities saw dictatorships justified in case they 
provided economic benefits or more security. The Latin American student question- 
naires in ICCS 2016, including the same item set and results, showed that levels 
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of support for authoritarian government and justification of dictatorship remained 
largely unchanged since 2009 (Sandoval-Hernandez et al., 2019; Schulz et al., 201 8a). 
ICCS 2022 measures students’ endorsement of authoritarian government practices 
with a reduced set of identical items. 


3.2.3 Attitudes Toward Civic Roles and Identities 


The following constructs reflecting student attitudes toward civic identities are 
measured as part of the international student questionnaire or the European and 
Latin American student questionnaires in ICCS 2022: 


e Perceptions of good citizenship behavior 

e Students’ sense of European identity (European student questionnaire) 

e Students’ expectations of their own individual future (European and Latin 
American student questionnaires) 


Students’ perceptions of good citizenship behavior: Similar to earlier IEA studies 
of civic and citizenship education (Torney et al., 1975; Torney-Purta et al., 2001, 
p. 77£), ICCS 2009 measured students’ perceptions of the importance of different 
types of behaviors for “good citizenship” and identified subdimensions concerned 
with conventional and with social-movement-related citizenship behavior (Schulz 
et al., 2010). Based on data from CIVED 1999 and ICCS 2009, Hooghe and Oser 
(2015) observed an increase in the support of engaged citizenship norms while duty- 
based citizenship norms became less widely supported. Following Kennedy’s (2006) 
distinction between active (conventional and social-movement-related) from passive 
citizenship elements (national identity, patriotism, and loyalty), ICCS 2016 used 
additional items to measure more passive forms of citizenship behavior adding a 
third factor that reflected personally responsible citizenship (Schulz et al., 2018b). 
Re-analyses of ICCS 2016 data also showed considerable variation across and within 
countries in terms of students’ citizenship profiles (Trevifio et al., 2021). In addition 
to asking students’ views about the importance of citizen behavior related to the 
two first dimensions (conventional and social-movement-related citizenship), ICCS 
2022 includes new items reflecting students’ perceptions of the importance of global 
citizenship behavior (such as showing interest in other cultures and languages or 
engaging in support of global issues). 

Students’ sense of European identity: European identity has been an important 
theme of debate over the past decade within the EU (Alnæs, 2013; Checkel & Katzen- 
stein, 2009; Delanty & Rumford, 2005; Duchesne, 2008; European Commission, 
2012; Herrmann et al., 2004; Karolewski & Kaina, 2006, 2013; Spannring et al., 
2008), in particular following the establishment of European institutions, the inte- 
gration of EU member countries, and the Treaty on the European Union (Treaty of 
Maastricht) and their implications on European identity and citizenship (Osler & 
Starkey, 2008). ICCS 2009 showed that, while most students regarded themselves as 
Europeans, relatively few students viewed their European identity as more important 
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than their national identity (Kerr et al., 2010). Based on a comparable set of items, 
the European ICCS 2016 questionnaire showed considerable increases in young 
people’s identification with Europe between 2009 and 2016 (Losito et al., 2018). 
ICCS 2022 continues to measure young European’s perceptions of their identification 
with Europe as a region. 

Students’ expectations of their own individual future: In a previous part of the 
framework, we drew attention to the need to examine students’ expectations regarding 
their own individual future. There is a body of literature concerned with the measure- 
ment of beliefs about, and perceptions of the future or future time perspectives 
(Husman & Shell, 2008; Rizzo & Chaoyun, 2017), including those that go beyond 
dispositional optimism and pessimism (Lemola et al., 2010). The ICCS 2016 Euro- 
pean student questionnaire asked students about the likelihood of finding employment 
and better financial conditions in the future, and results showed that most students had 
positive perceptions of their own life in the future (Losito et al., 2018). ICCS 2022 
includes measures of students’ perceptions of their own individual future in both 
the European and Latin American student questionnaires. In addition, the European 
student questionnaire includes a question asking students about the importance of 
some aspects of their life in the future (e.g., to have the opportunity to work abroad, 
to have friends). 


3.3 Engagement 


In ICCS 2022, the affective-behavioral area engagement refers to students’ self- 
beliefs about their interest and capacity to engage, expectations of future civic action, 
past and present engagement, and also include constructs such as preparedness to 
participate in forms of civic protest and anticipated future political participation as 
adults. In addition, due to active involvement in civic practices open to this age group 
(such as school-based activities, youth organizations, or community groups), young 
people may now also become involved in virtual networks through social media. 
These newer forms of engagement receive more explicit recognition in ICCS 2022 
than in previous cycles. Furthermore, it is also of interest to distinguish between 
engagement with different levels of the Contextual Framework (or organizational 
levels), which may range from participation in activities at a local level to activities 
that are organized at national or supra-national levels. At the same time, it is important 
to keep in mind that issues triggering engagement do not necessarily coincide with 
the levels that are the focus of engagement, for example, activities related to national 
or global issues may be undertaken at a local level. 

Ekman and Amna (2012) regarded civic participation (latent political participa- 
tion) as distinct to the manifestation of political participation and argued for distin- 
guishing individual forms from collective forms of engagement. Given that political 
passivity has been identified in many societies as a growing phenomenon, espe- 
cially among young people, it is important to further distinguish unengaged from 
disillusioned citizens (Amna & Ekman, 2014). While unengaged passive citizens are 
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keeping themselves informed and are willing to consider civic engagement if needed, 
disillusioned passive citizens have lost faith in the possibility of influencing and 
have become alienated. Therefore, in addition to active engagement, basic disposi- 
tions toward engagement (interest or self-efficacy) and behavioral intentions (under- 
lying preparedness to act) are of crucial importance when studying young people’s 
engagement. 

ICCS 2022 conceptualizes the constructs and measures related to engagement 
according to the following subareas, which all cover similar aspects to those included 
in the content domain civic participation in the Civic Knowledge Framework: 


e Experiences of engagement: examples include students’ engagement with social 
media for civic-related activities, involvement in community groups or organiza- 
tions, or civic-related activities at school. 

e Dispositions toward engagement: examples include students’ sense of citizenship, 
self-efficacy, and their interest in political and social issues. 

e Expected future engagement: examples include expected student participation 
in legal or illegal activities to express opinions or expected electoral and active 
political participation. 


3.3.1 Experiences with Engagement 


When studying students in lower-secondary education, it is important to keep in mind 
that there are limitations for this age group in terms of access to many forms of citi- 
zenship participation in society. However, there is evidence of links between youth 
participation and later engagement as adult citizens (Verba et al., 1995). Further- 
more, having been part of civic-related activities at school has been suggested as an 
influencing factor for future citizenship engagement (Pancer, 2015; Putnam, 2000). 
In view of the latter, it needs to be acknowledged that current or past involvement 
in youth groups, school governance, or campaigns may play a role as a contextual 
factor in shaping civic-related learning outcomes. 

ICCS 2022 includes measures of the following types of active students’ civic 
engagement: 


Students’ engagement in organizations and groups (outside of school) 

Students’ engagement in school activities 

Students’ engagement using digital technologies 

Students’ reports on behaviors related to political and ethical consumerism and 
on their sustainable behaviors (European student questionnaire) 


Students’ civic participation in organizations and groups: Citizens’ involvement 
in organizations and groups can be seen as a clear indicator of civic engagement 
(Putnam, 2000; Van Deth et al., 1999). However, it can also be regarded as a resource 
for future engagement (Putnam, 1993), and in recent years a growing involvement of 
young people in global movements such Fridays for Future has been observed (De 
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Moor et al., 2020). ICCS 2009 asked students about their current or past participa- 
tion in organizations in their communities, such as human-rights groups, religious 
associations, and/or youth clubs. Similar to the findings of the CIVED study in 1999 
(Amadeo et al., 2002; Torney-Purta et al., 2001), ICCS 2009 results showed that only 
smaller proportions among students reported that they had participated in these orga- 
nizations or groups (Schulz et al., 2010). ICCS 2016 assessed students’ participation 
in the community with a slightly modified set of 10 items (including three optional 
items). Results confirmed that relatively few young people in this age group had been 
involved in organizations and groups in the community (Schulz, 2018; Schulz et al., 
2018b). ICCS 2022 includes a set consisting of old and new items to measure past 
and current student engagement. 

Students’ civic participation in school activities: Numerous scholars have under- 
lined the importance of students’ experience at school for developing a sense of 
power to influence matters in the community (Bandura, 1997). Research has provided 
evidence that more democratic forms of school governance can contribute to higher 
levels of political engagement (see for example, Pasek et al., 2008). ICCS 2009 
and 2016 included questions about a wide range of civic-related participation at 
school (for example, in school councils/parliaments, or in student debates) and results 
showed that majorities of students reported past or current participation in many of 
these activities at school. The findings further suggested positive relationships with 
civic knowledge and engagement (Schulz, 2018; Schulz et al., 2010, 2018b). ICCS 
2022 continues to measure past or current civic engagement within the school context 
using a modified set of items. 

Students’ civic engagement using digital technologies: The importance of social 
media has risen greatly over the past years (Banaji & Buckingham, 2013; Kahne 
et al., 2014; Mihailidis, 2011; Rainie et al., 2012; Segerberg & Bennett, 2011) and 
research suggests a potential enhancement of civic participation among people when 
content is interactive (for example, via chat rooms or message boards) instead of 
the one-way communication of more traditional media (Bachen et al., 2008; Kahne 
et al., 2012). The ICCS 2016 student questionnaire included items that measured the 
extent to which students engaged with political and social issues via social media. 
Results showed that more active civic engagement through these channels was still 
limited and varied considerably across participating countries (Schulz et al., 2018b). 
ICCS 2022 measures students’ engagement with social media using a modified and, 
compared to ICCS 2016, broader set of items. 

Students’ reports on behaviors related to political and ethical consumerism in 
Europe: The promotion of sustainable behaviors, together with the development of 
knowledge, skills, and values, is one of the most relevant aspects of education for 
sustainable development (UNESCO, 2005). As such, it is becoming increasingly 
recognized as an important aspect of education as a whole and is part of UNESCO’s 
Strategic Development Goal 4.7 (Smart et al., 2019; UNESCO, 2015). Sustainable 
behavior can be defined as the extent to which decisions are driven to benefit or 
reduce the impact on the environment (Stern, 2000). The ICCS 2022 European ques- 
tionnaire includes a question asking students about their or their parents’/guardians’ 
consumer behaviors related to expressions of political beliefs. Another question in 
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this instrument asks about students’ reports on the frequency of undertaking a range 
of sustainable behaviors. 


3.3.2 Dispositions Toward Engagement 


With regard to students’ dispositions toward civic engagement, ICCS 2022 distin- 
guishes the following: 


e Students’ interest in political and social issues 
e Students’ sense of citizenship self-efficacy 


Students’ interest in political and social issues: Research has shown that interest 
in politics is strongly influenced by socialization at home (Neundorf et al., 2017). 
Earlier IEA civic and citizenship education studies already included measures of 
student interest, which turned out to be a positive predictor of civic knowledge and 
participation (Amadeo et al., 2002; Torney et al., 1975; Torney-Purta et al., 2001). 
ICCS 2009 used a list of items covering students’ interest in a broader range of six 
different political and social issues, and results showed that students tended to have 
considerable interest in social and also political issues in their own countries but were 
less interested in international politics (Schulz et al., 2010). ICCS 2016 measured 
students’ (overall) interest in political and social issues in conjunction with a question 
about their parents’ interest in these issues. Results showed that students’ interest 
was positively associated with expected civic engagement in the future (Schulz et al., 
2018b). Students’ interest in political and social issues continues to be measured in 
ICCS 2022 with the same item as in ICCS 2016. 

Students’ sense of citizenship self-efficacy: This construct reflects students’ self- 
confidence in active citizenship behavior. Individuals’ “judgments of their capabil- 
ities to organize and execute courses of action required to attain designated types 
of performances” (Bandura, 1986, p. 391) are deemed to have a strong influence 
on individual choices, efforts, perseverance, and emotions related to the tasks. The 
concept of self-efficacy constitutes an important element of Bandura’s social cogni- 
tive theory about the learning process, in which learners direct their own learning 
(Bandura, 1993). ICCS 2009 and 2016 included seven items reflecting different activ- 
ities that were relevant for students of this age group, and results from 2016 showed 
that students’ confidence to participate in civic activities tended to be stronger than in 
the previous cycle (Schulz et al., 2018b). ICCS 2022 continues to measure students’ 
citizenship self-efficacy with a modified and broader set of items. 


3.3.3 Expected Future Engagement 


Given the limitations for young people in their eighth year of schooling to actively 
participate in society, many aspects of civic and citizenship engagement can only be 
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assessed by asking about expected future behavior. The theory of planned behavior 
(Ajzen, 2001; Ajzen & Fishbein, 2000) links attitudes to behaviors through inten- 
tions, and posits that attitudes influence actions through reasoned processes (that are 
manifested as intentions). 

While political participation is one central aspect of possible future civic engage- 
ment (Verba et al., 1995), itis also important to view civic engagement as broader and 
reflective of all “people’s connections with the life of their communities, not merely 
politics” (Putnam, 1993, p. 665). In view of political developments throughout the 
1970s and 1980s, scholars introduced a distinction between “conventional” (voting, 
running for office) from “unconventional (social movement)” activities (grass-root 
campaigns, protest activities) (Barnes & Kaase, 1979), with the latter type potentially 
including legal as well as illegal forms of engagement (Kaase, 1990). 

With the recent rapid expansion of new types of political activities, Van Deth 
(2014) further identified problem- or community-oriented forms of participation as 
well as individualized and creative modes of participation (see also Theocharis & 
Van Deth, 2018; Weiss, 2020). 

ICCS 2022 distinguishes between the following three types of expected future 
engagement: 


Expectations of participating in future school-based activities 
Expectations to participate in legal and illegal forms of civic action in support of, 
or in protest against, important issues 

e Expectations of political participation as adults 


Students’ expectations of participating in future school-based activities: Keating 
and Janmaat (2015) presented results from longitudinal data in the United Kingdom 
suggesting that participation in school-based political activities has a positive influ- 
ence on future electoral and political engagement. ICCS 2016 developed questions 
assessing students’ beliefs about their expectations of undertaking future civic activ- 
ities within the school context (for example, voting in school elections or engaging 
in a public debate about school-related issues), and results showed that students’ 
willingness to become involved at school was higher among females and students 
with more interest in civic issues (Schulz et al., 2018b). ICCS 2022 continues to 
gather data on students’ expectations of civic engagement at school with an identical 
item set. 

Students’ expectations of participation in forms of civic action: In ICCS 2009 a 
set of nine items reflected students’ expectations for future involvement in protest 
activities (such as collecting petitions, participating in protest marches, or blocking 
traffic). The items related to two different dimensions of protest behavior: legal 
and illegal activities. Using a similar but modified question, ICCS 2016 measured 
forms of civic action, including those against and in support of issues. The items 
also included actions in support of environmental sustainability. Results confirmed 
earlier findings that legal activities were much more widely expected than illegal 
activities (Schulz et al., 2010, 2018b). Both dimensions continue to be assessed as 
part of ICCS 2022 with a slightly modified set of student questionnaire items that 
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also includes new items measuring the students’ expected engagement in support of 
environmental causes. 

Students’ expectations of political participation as adults: Young people who 
intend to participate in political activities have been shown to be much more likely 
to participate at a later point in time (Eckstein et al., 2013). ICCS 2009 and 2016 
asked students about these types of behavioral intentions using a set of nine items 
(two of which were optional for countries) reflecting on two different constructs 
(expected electoral participation and expected participation in political activities). 
While majorities of students across participating countries expected to participate 
in elections, relatively few students expressed intentions to engage in more active 
forms of political participation (Schulz et al., 2010, 2018b). ICCS 2022 continues 
to assess students’ expectations of participating in political participation as adults, 
with an identical item set as in ICCS 2016. 
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Chapter 4 A) 
Contextual Framework E 


4.1 Framework Scope and Structure 


TEA studies of civic and citizenship education have always focused on the individual 
student’s acquisition of knowledge, attitudes and dispositions for engagement, which 
is influenced by their connections with multiple civic communities. This was explic- 
itly expressed in the theoretical model underlying the IEA CIVED study in 1999, 
which asserted that young people’s learning of civic and citizenship issues was not 
limited to instruction at school but dependent on different “agents” of socializa- 
tion (Torney-Purta et al., 2001, p. 21). This conceptual view is influenced by and 
consistent with theories of ecological systems (Bronfenbrenner, 2004; Ettekal & 
Mahoney, 2017; Neal & Neal, 2013) and situated cognition (Anderson et al., 2000; 
Barsalou, 2016). It strongly emphasizes the importance of capturing relevant contex- 
tual information as part of this study in addition to measuring students’ cognitive 
and affective-behavioral learning outcomes. 

While ICCS broadened the conceptual framework underpinning the IEA CIVED 
study in 1999 through the inclusion of further aspects (see Schulz, 2021), it main- 
tained the conceptual view of regarding the civic learning of young people as a 
result of interactions with multiple civic communities, in addition to formal educa- 
tion (Schulz et al., 2008). The ICCS 2022 contextual framework describes the vari- 
ables that are important to consider when studying learning outcomes of civic and 
citizenship education. ICCS assumes that the individual student is located within 
overlapping contexts of school and home. Both these contexts form part of the local 
community which, in turn, is embedded in the wider sub-national, national, and 
international contexts. 

As in previous ICCS frameworks, the contextual framework for ICCS 2022 
distinguishes the following four levels: 


e The context of the wider community comprises the broader context within which 
schools and home environments operate (ranging from local to global levels). 
Factors can be found at local, regional, and national levels. For a number of 
countries, the supra-national level has also become relevant as, for example, for 
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member countries of the European Union. Given the increased importance of 
digital technologies for communication and engagement, virtual communities 
connected through the internet also form part of this context. 

e The context of schools and classrooms comprises factors related to teaching and 
learning, the school culture, and the general school environment.! 

© The context of home and peer environments comprises factors related to the home 
background and the immediate social out-of-school environment of the student 
(for example, peer-group activities). 

e The context of the individual refers to the individual characteristics of the student 
(for example, their gender or educational aspiration). 


ICCS also groups contextual variables into the following types of variables: 


e Antecedents are pre-existing variables that shape how student learning and acqui- 
sition of civic-related understandings and perceptions takes place. Note that these 
factors are level-specific and may be influenced by antecedents or processes at a 
higher level. For example, civic-related training of teachers may be affected by 
historical factors and/or policies implemented at the national level. 

e Processes are those variables related to civic-related learning and the acquisition of 
understandings, competences, and dispositions. They are constrained or enabled 
by antecedents and possibly influenced by variables relating to the higher levels 
of the multi-level structure. 


Antecedents and processes are variables that have potential impact on outcomes at 
the level of the individual student. Learning outcomes related to civic and citizenship 
education at the student level also can be viewed as aggregates at higher levels 
(school, country) where they can affect factors related to processes. For example, 
having higher levels of civic understanding and engagement among students may 
influence the way schools and educators teach content or organize activities related 
to civic and citizenship education. 

Figure 4.1 illustrates which contextual variables might influence the learning 
outcomes of civic and citizenship education. It is important to emphasize that “feed- 
back” may occur between civic- related learning outcomes and processes in terms of 
a reciprocal relationship between these two types of variables. For example, students 
with higher levels of civic knowledge and engagement would be expected to partic- 
ipate more frequently in activities (at school, at home, and within the community) 
that, in turn, promote these outcomes. 

There is a unidirectional relationship between antecedents and processes at each 
level. However, higher-level processes may influence antecedents, and it is likely that, 
from a long-term perspective, outcomes may affect variables that are antecedents for 
learning processes. 

This contextual framework for ICCS makes it possible to map variables for which 
data are collected on a three-by-four grid, with antecedents, processes, and outcomes 
as columns, and the levels of country/community, school/classroom, student, and 


' Because of the sampling design for ICCS, school level and classroom level cannot be disentangled. 
Generally, only one class- room will be selected within each sampled school. 
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Antecedents Processes 

Wider community Wider community 
Education system & polices Educational policies 

History & culture Political events 


Political events 


School/classrom: School/classrom: 
Characteristics Instruction Outcomes 
Composition Governance 
a cae a AERA pas Cognitive and 
Student: j i 
affective-behavioral 
Student: Socialization ff á 
Characteristics & learning learning outcomes 


Home and peer environment: 
Family background 
Social group 


Home and peer environment: 
Communication 
Media use 


Fig. 4.1 Contexts for the development of learning outcomes related to civic and citizenship 
education 


home environment, as rows (Table 4.1). Although the last column for outcomes is 
not split into levels, it is important to recognize that, for the analysis of ICCS data, 
aggregates can also be used at wider community or school/classroom levels.? 

Table 4.1 shows examples of potential variables (or groups of variables) collected 
with different ICCS instruments for each cell in this grid. Variables related to the 
context of country/community are collected primarily through the national contexts 
survey and other possible data sources. Variables related to the context of schools and 
classrooms are collected through the school and teacher questionnaires. The student 
questionnaire provides information on antecedents of the individual student and the 
home environment as well as some process-related variables (for example, learning 
activities). The student test and the student perceptions questionnaire collect data 
on outcomes. In addition, the student background questionnaire includes questions 
regarding student participation in civic-related activities that will provide indicators 
of active citizenship related to content domain 3 (civic participation). 

Some potential variables can be measured at one level pertaining to another 
level (such as school principals’ perceptions of the local community) and are not 
included in the mapping shown in Table 4.1. It is also important to note that student 
observations of learning practices in the classroom can be aggregated and used as 
classroom or school variables. Furthermore, student, school, and teacher question- 
naire data might also provide civic-related information about the context of the local 
community. 


2 Note that similar conceptualizations have been used for the planning of other international studies 
(see, for example, Harvey-Beavis, 2002; OECD, 2005; Travers & Westbury, 1989; Travers et al., 
1989). 
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Table 4.1 Mapping of variables to contextual framework (examples) 


Contextual Framework 


Level of ... Antecedents Process Outcomes 
Wider community NCS and other NCS and other StT, StQ, StE & StL: 
sources: democratic sources: intended Civic knowledge, 
history structure of curriculum political attitudes and 
education developments engagement 
School/classroom ScQ and TQ: School ScQ and TQ: 
characteristics implemented 
Resources curriculum 
Policies and practices 
Student StQ: StQ: 
Gender Civic learning 
Age Practiced engagement 
Home and peer StQ: StQ: 
environment Socio-economic Family 
background communication 
Language use at home | Communication with 
Country of birth peers 
Media information 


Note NCS national contexts survey; ScQ school questionnaire; TQ teacher questionnaire; StE Euro- 
pean student questionnaire; StL Latin American student questionnaire; StQ student questionnaire; 
StT student test 


4.2 The Context of the Wider Community 


ICCS views the context of the wider community as consisting of different levels 
because the students, their schools, home, and peer environments are located in 
their local communities, which in turn are embedded within broader contexts of 
regional, national, and supranational contexts. Within the scope of this study, at the 
level of the wider community, contexts related to local and national levels are of 
particular relevance. However, due to increasing globalization, connectedness via 
digital technologies and the growing importance of supranational organizations, it is 
important to consider contexts beyond the nation-state within the scope of ICCS. 


4.2.1 The Context of the Educational System 


For an investigation of how young people in lower-secondary education develop 
civic-related dispositions and competences and acquire understandings with regard 
to their role as citizens, it is crucial to give proper consideration to the national 
level. Historical background, the political system, the structure of education, and the 
curriculum are important contextual variables that need to be considered when inter- 
preting results from an international assessment of civic and citizenship education. 
Data from official statistics provide a range of relevant contextual data at the country 
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level; regarding the structure of the education system, the nature of the political 
system, and the economic and social context of the society. 

As in previous cycles, the national contexts survey for ICCS 2022 is designed 
to provide for a systematic collection of relevant data based on expertise provided 
by the national research centers. These data include information on the structure of 
national education systems, education policies, approaches to civic and citizenship 
education, teacher training in general and for civic and citizenship education in 
particular, and approaches to assessment and quality assurance regarding the area 
of civic and citizenship education. The survey also collects information on recent or 
current debates and reforms related to this learning area. 


The structure of the education system 


Despite a number of global trends in education that have increasingly led to many 
common features in policies and structures across countries (Benavot et al., 1991; 
Frank & Meyer, 2021; Wiseman & Baker, 2005), differences between education 
systems continue to have a considerable effect on the outcomes of education (Baker & 
LeTendre, 2005; Woessmann, 2016). 

To capture such basic differences at the national level, the ICCS 2022 national 
contexts survey collects system-level data on the structure of school education (study 
programs, public/private school management, types of lower-secondary education 
institutions), the autonomy of educational providers with regard to different aspects, 
and the length of compulsory schooling. Further, it also gathers information about 
changes in the structure since the previous ICCS cycle in 2016. 


Education policies and developments regarding civic and citizenship education 


Previous reviews of educational policies regarding civic and citizenship education 
have indicated the presence of a wide range of objectives related to the area (Birzea 
et al., 2004; European Commission/EACEA/Eurydice, 2012, 2017; Lee et al., 2004; 
Torney-Purta et al., 1999). Despite this presence, results from previous cycles of 
ICCS (Ainley et al., 2013; Schulz et al., 2010, 2018b) showed the priority assigned 
to civic and citizenship education was frequently reported as low across partici- 
pating countries. While civic goals tended to be reported as important in principle, 
there were substantial differences in the approaches toward the delivery of curricular 
content across countries. Findings from the two previous cycles of the study also 
highlighted the fact that explicit civic and citizenship education in many countries 
tends to commence after students reach the age of 14. 

It is important to acknowledge that between study cycles there may be educa- 
tional reforms in countries, typically designed to improve educational provision and 
outcomes or better reflect government priorities, and that such changes potentially 
also affect aspects of civic and citizenship education. Many of these educational 
reforms tend to be implemented in response to the challenges of learning and living 
in modern societies, as well as changes in political systems (Ainley et al., 2013; Cox 
et al., 2005). 

The ICCS 2022 national contexts survey collects data on the definition of, and 
the priority given to, civic and citizenship education in the educational policy and its 
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provision in each participating country at the time of the data collection. National 
centers provide information about the official definition of civic and citizenship 
education, its formal implementation in lower-secondary education, and its main 
goals. National centers are also asked about the potential influence of historical, 
cultural, political, and other contexts on the character of, and approach to, civic and 
citizenship education, whether there have been major national or international studies 
about this learning area since 2005, and whether there have been any substantial 
changes since the previous survey from 2016. 

In view of the recent educational disruptions across countries due to the COVID- 
19 pandemic, the national contexts survey also gathers data about the extent to which 
teaching and learning, in general, and regarding civic and citizenship education, was 
affected, and whether there has been formal support for the development of digital 
resources in this learning area. Furthermore, the national contexts survey collects 
information about the effects of the 2022 Ukraine crisis on civic and citizenship 
participation in ICCS 2022 countries. 


Civic and citizenship education and school curriculum approaches 


Countries take different approaches to the implementation of civic and citizenship 
education in their curricula and the ways it is implemented tend to vary consid- 
erably across countries (Ainley et al., 2013; Cox et al., 2005; European Commis- 
sion/EACEA/Eurydice, 2017). Some educational systems have included civic and 
citizenship education in their curricula as a compulsory or optional (stand-alone) 
subject, whereas others include it through integration into other subjects. Alterna- 
tive approaches to civic and citizenship education, typically chosen in addition to 
learning based on subject matter, are the implementations of civic-related cross- 
curricular themes or the adoption of a whole school approach, where all aspects of 
schooling are considered to be contributing to this learning area. Previous cycles 
of ICCS showed that in many education systems and/or schools, combinations of 
different approaches are implemented at the same time (Ainley et al., 2013; Schulz 
et al., 2018b). 

With regard to school curriculum approaches for civic and citizenship education, a 
Eurydice report from 2012 (European Commission/EACEA/Eurydice, 2012) distin- 
guished between (i) promotion through steering documents such a national curricula 
or other recommendations/regulations, (ii) support for school-based programs and 
projects, and (iii) the establishment of political structures (such as school parlia- 
ments). In this context it is also important to review the extent to which schools 
in different countries provide support for civic and citizenship education through 
school culture or ethos, democratic school governance, and the establishment of 
links with the wider community (Birzea et al., 2004; Council of Europe, 2018; Euro- 
pean Commission/EACEA/Eurydice, 2012). Results from ICCS 2009 showed that 
many countries include recommendations for the establishment of democratic school 
practices in their educational policies (see Ainley et al., 2013). 

The national contexts survey in ICCS 2022 gathers data on the inclusion of 
civic and citizenship education (as a separate subject, or integrated into different 
subjects, or as cross-curricular approach) in the formal curriculum at different stages 
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of schooling and in distinct study programs. The survey also captures the names of 
specific curriculum subjects and whether these are compulsory or optional at each 
educational level (primary, lower and upper secondary). Furthermore, the national 
contexts survey collects data regarding the aims of the national or official curricula 
for civic and citizenship education related to specific contexts such as whole school 
and school curriculum approaches, student participation or parental involvement, 
and links to the wider community. 

Because ICCS surveys students in a specific target grade in lower secondary 
programs (typically Grade 8), the national contexts survey gathers more detailed 
information about the curricular context for civic and citizenship education for this 
particular grade. In addition, national centers report on the specification of topics, 
objectives, and processes when implementing the school curriculum, as well as the 
amount of instructional time given to civic and citizenship education. The national 
context survey for ICCS 2022 includes content reflecting changes to the frame- 
work including questions about global citizenship values, the presence of policies 
for intercultural education, addressing diversity at school, inclusive education, the 
promotion of democratic ideals in schools, and the use of digital technologies to 
encourage civic engagement. This is further reflected in additional questions related 
to curricula contents on the new or further developed focus areas for ICCS 2022. 


Teachers and civic and citizenship education 


The teacher survey undertaken as part of the CIVED survey showed a great deal 
of diversity in the subject-matter background, professional development, and work 
experience of those teachers involved in civic and citizenship education (Losito & 
Mintrop, 2001). In relation to teacher training in this field, research showed a rather 
limited and inconsistent approach to in-service training and professional development 
(Birzea et al., 2004; European Commission/EACEA/Eurydice, 2005). The results of 
previous national contexts surveys showed that, while in most participating countries, 
pre-service and in-service training was provided, in most cases, this provision was 
typically reported as non-mandatory (Schulz et al., 2010, 2018b). In some countries, 
data from previous cycles of ICCS have contributed to improving teacher education 
in terms of pre- and in-service training (Malak-Minkiewicz & Torney-Purta, 2021). 

To assess the variety of different approaches to teacher education in the field at 
the level of education systems, the national contexts survey in ICCS 2022 collects 
data about the general requirements for becoming a teacher and about licensing 
or certification procedures for teachers. More specifically, the survey gathers data 
about the characteristics of teachers of civic and citizenship education in terms of 
their subject area, the extent to which civic and citizenship education is part of pre- 
service or initial teacher education, and the availability of in-service or continuing 
professional development education, as well as the type of providers available for 
continuing education and professional development. Furthermore, the ICCS 2022 
national contexts survey gauges whether different civic-related topics and skills are 
specified as goals for initial teacher education programs. 
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Assessment and quality assurance in civic and citizenship education 


Comparisons of assessment and quality assurance for civic and citizenship education 
are difficult and complex due to the diversity of approaches to teaching this subject 
area across countries. Research in Europe shows that, in most countries, compared to 
other subject areas, monitoring and quality assurance in civic and citizenship educa- 
tion are often unconnected and carried out on a small scale (Birzea et al., 2004). 
However, over the last decade, some countries have started to implement nation- 
wide assessments of civic and citizenship education (Ainley et al., 2013; European 
Commission/EACEA/Eurydice, 2017; Malak-Minkiewicz & Torney-Purta, 2021). 

The national contexts survey includes questions about the extent and methods for 
assessment in the area of civic and citizenship education at the country’s target grade, 
and how parents are informed about current aims and approaches regarding this field 
of learning. 


4.3 The Contexts of Schools and Classrooms 


As in previous survey cycles, ICCS 2022 views students’ learning outcomes in 
the field of civic and citizenship education not only as a result of teaching and 
learning processes but also as a result of their daily experiences at school (Council 
of Europe, 2018; European Commission/EACEA/ Eurydice, 2017; Scheerens, 2009, 
2011). School experiences and their impact on learning outcomes are of particular 
importance in the context of civic and citizenship education, as they develop learning 
outcomes that are not confined to the area of cognitive achievement but also include 
attitudes and dispositions for engagement. 

The possibility of establishing and experiencing relationships and behaviors based 
on openness, mutual respect, and respect for diversity, as well as the possibility 
of giving and asserting personal opinions, allow students to practice a democratic 
lifestyle, to begin exercising their own autonomy, and to develop a sense of self- 
efficacy (seeMosher et al., 1994; Pasek et al., 2008). Three key areas need to be 
considered for making the schools a democratic learning environment: teaching 
and learning, school governance and culture, and cooperation with the commu- 
nity. Creating a democratic learning environment in this way is referred to as the 
whole school approach, which aims to integrate democratic values into teaching 
and learning practices, decision-making processes and school governance, and the 
general school atmosphere (Council of Europe, 2018). 

In view of the importance of school and classroom contexts for civic and citizen- 
ship education, ICCS 2022 administers the following types of questions to school 
principals, teachers, and students: 


© Questions that measure principals’ perceptions of school contexts and character- 
istics (school questionnaire) 
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© Questions about the background of teachers (age, gender, and their teaching 
of subject areas in general, and at the target grade) as well as a wide range of 
perceptions of school and classroom contexts (teacher questionnaire) 

© Questions about students’ perceptions of school and classroom contexts (student 
questionnaire) 


As in ICCS 2016, several questions included in the school and teacher ques- 
tionnaires are similar, with the aim of collecting data on the same issues from the 
perspective of teachers and school principals. In ICCS 2022, one question included 
in the student questionnaire was also included in the teacher questionnaire (teachers’ 
perceptions of good citizenship). 


4.3.1 The Relations Between Schools and Their Local 
Communities 


There is evidence that students from non-urban school contexts often perform at 
lower achievement levels than those from urban schools (see, for example, Istrate 
et al., 2006; Webster & Fisher, 2000; Williams, 2005), although studies also observed 
variations in student achievement within urban contexts (Ramlackhan & Wang, 2021; 
Shores et al., 2020). Data on school location (urbanization) were used in multi-level 
analyses carried out in ICCS 2009 and in a few countries, urbanization was associated 
with student knowledge (see Schulz et al., 2010). In Latin American countries, there 
were significant differences in civic knowledge between rural and urban schools, 
however, these were largely due to differences in socioeconomic background of 
individual students and their schools (Schulz et al., 2011). As in previous ICCS 
surveys, the ICCS 2022 school questionnaire includes a question about the size of 
the community in which the school is located. 

Schools and homes of students are located in communities that vary in their 
economic, cultural, and social resources, and in their organizational features. Inclu- 
sive communities that value community relations and facilitate active citizen engage- 
ment, especially if they are well resourced, may offer civic and citizenship opportuni- 
ties for partnerships and involvement to schools and individuals. Social and cultural 
stimuli arising from the local community, as well as the availability of cultural 
and social resources, may influence young people’s civic and citizenship knowl- 
edge, dispositions, and competences in relation to their roles as citizens (Jennings 
et al., 2009). The ICCS 2022 school questionnaire includes a question asking about 
principals’ reports on collaboration between the school and their local community. 

Differences in the quantity and quality of resources for citizenship learning avail- 
able in the local area may have a dual effect. On the one hand, they may favor the 
organization of community-oriented projects and student participation in projects, 
which require the development of activities involving the community, both of which 
can contribute to developing skills and competences related to civic and citizenship 
education. On the other hand, community participation in the life of the school and 
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in its various levels can be a factor for greater openness and democratization of 
the school itself. Furthermore, the level of resources may influence the provision 
of local support to schools, which in turn may impact the possibilities for school 
improvement (Reezigt & Creemers, 2005; Verhelst et al., 2020). In several countries 
participating in ICCS 2009 differences regarding the availability of resources in the 
local community were associated with students’ civic knowledge (see Schulz et al., 
2010). As in previous cycles, ICCS 2022 continues to measure the availability of 
resources in the local community in the school questionnaire. 

As part of the community within which it is located, the school may be affected 
by issues and problems existing at the community level. Issues of social tension 
within the local community may influence students’ social relationships and the 
quality of their social lives and everyday experiences, both outside and inside the 
school (LV Homme & Jerez Henríquez, 2010). In addition to that, students’ actual 
opportunities to volunteer or participate in civic-related activities in the communities 
may be influenced by cultural, economic, political, and social factors at the local 
community level within which schools are located. A safe social environmentis likely 
to enhance students’ activities and participation in the local community. Conversely, 
issues creating social tensions and conflicts in the local community may discourage 
students’ involvement in civic activities. In ICCS 2009 and 2016, principals were 
asked about their perceptions of social tensions in the community, and the results 
showed a negative association between higher levels of perceived social tension and 
students’ civic knowledge (Schulz et al., 2010). The ICCS 2022 school questionnaire 
continues to collect data on these aspects. 

Research has illustrated the importance of students’ activities in the community 
and their reflection on them for the construction and the development of knowledge 
and skills for active citizenship (Annette, 2008; Henderson et al., 2013). Schools’ 
interactions with their local communities, and the links that have been established 
with other civic-related and political institutions, also have the potential of influ- 
encing student perceptions of their relationship with the wider community and of the 
different roles they may play in it (Annette, 2000, 2008; Potter, 2002; Torney-Purta & 
Barber, 2004). ICCS 2009 and 2016 showed that most of the students in almost all the 
participating countries had at least some opportunities to participate in such activ- 
ities (Schulz et al., 2010, 2018b). ICCS 2022 continues to collect data reflecting 
principals’ perceptions of the opportunities’ students have to participate in activities 
carried out by the school in cooperation with external groups or organizations. 

The teacher questionnaires from previous cycles also included a question on 
student participation in civic-related activities in the local community, which was 
similar to the question included in the school questionnaire about principals’ view of 
students’ opportunities to engage in the community. Results were generally consistent 
with those associated with principals’ answers (Schulz et al., 2010, 2018b). Compar- 
isons between the principals’ and teachers’ reports provided a broader picture of 
what schools actually do in terms of community-related activities from two different 
perspectives and viewpoints. The ICCS 2022 teacher questionnaire uses a similar 
question as in the previous surveys, which asks teachers whether they had participated 
with their students in activities in cooperation with external groups or organizations. 
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4.3.2 The School as a Learning Environment 


Students’, teachers’ and parents’ participation in the school life and governance 


Students’ experience with civic learning at school not only depends on the teaching 
and learning developed at a classroom level, but also on the possibilities they have to 
experience schools and classrooms as a “democratic learning environment’. Relevant 
factors include participation at the school level, the school and classroom climate, 
and the quality of the relationships within the school, between teachers and students 
as well as among students (Backman & Trafford, 2007; Council of Europe, 2018; 
Huddleston, 2007; Korkmaz & Erden, 2014; Thapa et al., 2013; Trafford, 2003). 
Results from ICCS 2016 showed substantial differences between countries in the 
extent to which students participated in school elections and to which they had 
opportunities to participate in school-decision making (Schulz et al., 2018b). ICCS 
2022 asks principals to provide information about students’ participation in school 
governance, students’ opportunities to contribute to decision-making processes at 
school (e.g., opportunities to express views on matters of concern or attend meetings), 
and, as in previous cycles, students’ participation in school elections. Furthermore, it 
gathers teachers’ perceptions of students’ participation in decision-making processes 
at classroom level. 

Teachers’ participation in school governance can be regarded as an important 
part of democratic governance processes at school and as a factor that potentially 
contributes to the characterization of the school as a democratic learning environment 
(Backman & Trafford, 2007; Council of Europe, 2018). Both the ICCS 2009 and 2016 
teacher questionnaires comprised questions asking teachers about their participation 
in school governance. The ICCS 2022 teacher questionnaire measures teachers’ 
willingness to take on responsibilities besides teaching, as well as their reflections 
on the extent to which they were willing to cooperate with other teachers to cooperate 
in conflict resolution within the school, and to engage in guidance and counselling 
activities. 

Empowering teachers to participate in decision-making at schools may contribute 
to active citizenship behavior within schools (Bogler & Somech, 2005). Since 
ICCS 2009, the school questionnaire included a question concerned with principals’ 
perceptions of teacher participation in school governance. As in previous cycles, the 
ICCS 2022 school questionnaire collects information about principals’ perceptions 
of teacher participation in the school governance. 

Parental involvement and empowerment have been reported as positive factors 
in their contribution to students’ academic achievement at school in general (Grif- 
fith, 1996). ICCS 2016 results showed that while there were high levels of parental 
involvement in communication processes, much lower levels were recorded for 
parental participation in decision-making processes (Schulz et al., 2018b). The ICCS 
2022 school questionnaire asks principals about parents’ participation in decision- 
making processes. Furthermore, the instrument contains a question about the schools’ 
provision of types of information for parents or guardians. 
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School and classroom climate 


School climate is widely regarded as an important factor in explaining student 
learning outcomes (Bryk et al., 2009; Wang & Degol, 2015). Scheerens and 
Bosker (1997) viewed school climate as a synonym for a school culture that is 
reflected in a range of variables related to student engagement, student absenteeism, 
student conduct and behavior, staff motivation, and relationships among students 
and between students and teachers within schools. More recent conceptualizations 
characterize school climate as encompassing four aspects: (1) academic climate 
and the prioritizing of successful learning, (2) interpersonal relationships within the 
school and with parents, (3) physical and emotional safety, and (4) organizational 
effectiveness (Powell et al., 2015; Wang & Degol, 2015). 

The school climate and the quality of the relations within the school (student— 
teacher relations and student-student relations) may influence student academic 
achievement (Bear et al., 2014), their sense of belonging to the school community 
(Knowles & McCafferty-Wright, 2015). The importance of a positive school climate 
for engaging students in civic-related learning experiences has also been emphasized 
in research about civic learning (see, for example, Homana et al., 2006). Both ICCS 
2009 and 2016 included items measuring students’ perceptions of school climate. 
Results from ICCS 2016 showed perceptions of positive student-teacher relations 
with students’ civic knowledge and support for gender equality and equal rights for 
all ethnic/racial groups in society (Schulz & Ainley, 2018; Schulz et al., 2018b). 
ICCS 2022 continues to gather data on students’ perceptions of aspects related to 
their school climate including students’ perceptions of student-teacher relations and 
student interaction at school. Furthermore, the ICCS 2022 teacher survey includes 
a question measuring teachers’ perceptions of issues of social tension at school. 

Classroom climate is a general concept, where definitions focus mainly on the 
level of cooperation in teaching and learning activities, fairness of grading, and 
social support. Democratic classroom climate focuses mainly on the implementation 
of democratic and liberal values in the classroom (Ehman, 1980; Hahn, 1999). A 
democratic classroom climate may help students to understand the advantages of 
democratic values and practices and may have a positive effect on their active assim- 
ilation (Perliger et al., 2006). Some studies have pointed out that, while teachers’ 
or principals’ perceptions of the classroom climate often tend to be unrelated to the 
students’ intentions of future engagement, students’ views of classroom climate are 
of critical importance (Hooghe & Quintelier, 2013). Several studies have further 
shown that a positive school climate may encourage students to share their opin- 
ions and is important for the academic and civic development of students (Mager & 
Nowak, 2012). 

Research findings have emphasized the importance of school and classroom 
contexts when investigating student engagement (see, for example, Reichert et al., 
2018). According to Barber et al. (2015), students who perceive a favorable class- 
room climate are more likely to be interested in politics, to trust civic institutions, 
to feel politically efficacious, and to aim to participate in legal forms of political 
behavior. 


4.3 The Contexts of Schools and Classrooms 73 


The first IEA civic education study in 1971 measured the classroom climate 
among students and found evidence for an association with civic learning outcomes 
including civic knowledge (Torney et al., 1975). The CIVED survey also included a 
set of items measuring students’ perceptions of what happened in their civic education 
classes. Six items were used to measure an index of open climate for classroom 
discussion (see Schulz, 2004) that had earlier been identified as a positive predictor 
of civic knowledge, and students’ expectations to vote as an adult (Torney-Purta et al., 
2001). The ICCS 2009 and 2016 surveys used a similar instrument that measured 
students’ perceptions of what happens in their classrooms during discussions of 
political and social issues. Results of multivariate analyses confirmed the association 
of this construct with civic-related learning outcomes (Lin, 2014; Schulz et al., 2010, 
2018b). The ICCS 2022 student questionnaire includes identical questions from 
previous surveys that are designed to measure students’ perceptions of openness in 
classroom discussions. 

The ICCS 2009 teacher questionnaire included a set of items measuring teachers’ 
perceptions of the classroom climate and results showed positive associations with 
civic knowledge in a number of countries (Schulz et al., 2010). ICCS 2022 continues 
to collect data on these aspects. 


Dealing with diversity at school 


In view of the growing diversity of student populations, schools are increasingly 
requested to develop institutional and instructional strategies and practices that allow 
students from different backgrounds to develop positive attitudes toward diversity 
(Trevifio et al., 2018). The ICCS 2022 school questionnaire collects data related to 
strategies and initiatives to foster students’ respect for different forms of diversity 
and to develop their intercultural skills. 

Research has shown how school principals and teachers play a key role in guaran- 
teeing an inclusive school for all students regardless of their ethnic or cultural back- 
ground (Billot et al., 2007; Leeman, 2003; Taylor & Kaur Sidhu, 2012), and has also 
emphasized how teacher education is essential for preparing teachers to work with 
diverse students (Alvarez Valdivia & Montoto, 2018; DeJaeghere & Zhang, 2008; 
Mushi, 2004; Tarozzi, 2014). The ICCS 2022 teacher questionnaire includes a ques- 
tion asking teachers about the frequency of different activities to address diversity 
within classrooms. In addition, the teacher questionnaire gathers data on perceptions 
of the impact of having students from different cultural and ethnic backgrounds and 
having students from different social and economic backgrounds in classrooms on 
teaching activities and the learning environment. 


4.3.3 Delivery of Civic and Citizenship Education at School 


Literature on school improvement shows that enabling some degree of autonomy 
favors the success of improvement efforts (Honig & Rainey, 2012; Reezigt & 
Creemers, 2005; Steinberg, 2014). Research findings have highlighted that school 
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autonomy, together with accountability measures at the national level, may support 
effective teaching and learning (Cheng et al., 2016; OECD, 2020). Studies also 
pointed out that, apart from the existence of regulations to foster school autonomy 
at the national level, its effects also depend on the ways in which it is implemented 
by individual schools, and in particular school principals, within school contexts 
(Agasisti et al., 2013; Neeleman, 2019). The level of autonomy provided to schools 
may influence the way civic and citizenship education is delivered at the school level 
(in terms of curriculum planning, choice of textbooks and teaching materials, or 
assessment procedures and tools). The existence of national legislation, regulations, 
and standards concerning the results that students should achieve, does not neces- 
sarily imply that schools deliver similar programs and approaches to teaching (Euro- 
pean Commission/EACEA/Eurydice, 2007, 2012), and the time allocated to citizen- 
ship education, teacher qualifications, and the support principals provide to civic and 
citizenship education within schools may vary (Keating & Kerr, 2013; Keating et al., 
2010; Malak-Minkiewicz & Torney-Purta, 2021). As in previous cycles, the ICCS 
2022 school questionnaire continues to include items measuring principals’ reports 
on school autonomy for the delivery of civic and citizenship education. 

Many studies have shown that curricular approaches to the teaching of civic 
and citizenship education vary considerably across countries. Civic and citizen- 
ship education is taught as a separate subject, is integrated in subjects related to 
human and social sciences or taught in all school subjects and is intended as a cross- 
curricular area (Ainley et al., 2013; Birzea et al., 2004; Council of Europe, 2018; 
Cox et al., 2005; European Commission/EACEA/Eurydice, 2005). ICCS 2009 and 
2016 results illustrated that these different approaches may coexist within the same 
schools (Schulz et al., 2010, 201 8b). Principals from schools surveyed in ICCS 2009 
and in ICCS 2016 also provided interesting information on how they rated the most 
important aims of civic and citizenship education. Results showed notable differ- 
ences across participating countries, however, school principals tended to regard the 
most relevant aims of civic and citizenship education to be those related to the devel- 
opment of knowledge and skills (Schulz et al., 2010, 2018b). A similar question was 
also included in the teacher questionnaire and the results were very similar to those 
from the survey of school principals (Schulz et al., 2010, 2018b). 

As in previous survey cycles, the ICCS 2022 school questionnaire includes a set 
of items asking principals about how civic and citizenship education is delivered at 
their schools and about their perceptions of the importance of aims for civic and 
citizenship education. This question about the importance of different aims for civic 
and citizenship education is also included in the ICCS 2022 teacher questionnaire. 

The ICCS 2009 teacher questionnaire included two set of items related to the 
way civic and citizenship education is delivered at the school level. ICCS 2009 also 
included two questions asking teachers about their perceptions of the importance of 
the aims of civic and citizenship education, and about how specific responsibilities 
for civic and citizenship education are assigned within the school. As in previous 
survey cycles, the ICCS 2022 teacher questionnaire includes a set of items measuring 
teachers’ perceptions of the delivery of civic and citizenship education at school. 
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Secondary analyses of ICCS 2009 data, have shown how different profiles of 
teachers’ beliefs are associated with teacher background and national contexts, and 
that only a small proportion of teachers believe that it is important to encourage 
students to participate in political or civic activities (Reichert & Torney-Purta, 2019). 
ICCS 2022 asks teachers to rate the importance of different behaviors to become good 
adult citizens, using identical items as those used to measure students’ perceptions 
of good citizenship behaviors in the student questionnaire. 

CIVED 1999 asked students to report how much they had learned about civic 
issues at school. Students? answers to how much they had learned about the impor- 
tance of voting at school were used as a (positive) predictor to explain variation 
in expected participation in elections (Torney- Purta et al., 2001). The ICCS 2016 
student questionnaire included a question asking students to assess how much they 
have learned in school about seven different political or social issues, and results 
showed associations with their civic interest, educational aspirations, and civic 
knowledge (Schulz et al., 2018b). ICCS 2022 continues to gather data on students’ 
perceptions of civic learning with slightly modified item sets. 

The European student questionnaire in ICCS 2009 and 2016 asked students about 
their opportunities to learn about Europe at school, and results showed that majorities 
of students across participating countries reported learning about a wide range of 
issues (Kerr et al., 2010; Losito et al., 2018). The same question is included in the 
European student questionnaire in ICCS 2022. 

Global citizenship education (GCED) which aims at developing the learner’s 
competence as a community member and a global citizen, is increasingly viewed 
as an important aspect of citizenship education (Davies, 2006; Guo, 2014). GCED 
is intended to be interdisciplinary and holistic, and therefore should be represented 
throughout the curriculum. In view of this aim, it is argued that it needs to involve the 
whole school community rather than just being a teacher- driven activity (UNESCO, 
2015). ICCS 2022 collects data from principals about school activities related to 
global citizenship. 

Increasingly, school activities related to environmental sustainability are viewed 
as an important part of citizenship education (Huckle, 2008). The concept of “sustain- 
able schools” (Henderson & Tilbury, 2004) refers to initiatives to establish learning 
environments that respect the principles of sustainable development and aim to enable 
students to experience these principles directly. Adopting school-level measures to 
make schools more climate-friendly is noteworthy as an initiative within the context 
of UNESCO’s activities to promote education for sustainable development (Gibb, 
2016). The ICCS 2016 school questionnaire asked principals about the initiatives 
undertaken by the schools in order to become more environmentally friendly (Prin- 
cipals’ reports on environment-friendly practices at school). The ICCS 2022 school 
questionnaire includes a modified version of this question with an increased focus 
on education for sustainable development. 

In view of an increased recognition of the importance of raising awareness of 
the impact of human behavior on the environment (Kyburz-Graber, 2013; Lundholm 
et al., 2013), the ICCS 2016 teacher questionnaire included a question that asks about 
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teachers’ involvement in initiatives and programs related to environmental sustain- 
ability (UNESCO, 2012a). Results from ICCS 2016 showed that the most common 
activities, across countries, were those related to water and energy consumption, 
while lower percentages were recorded for signing a petition, writing letters to a 
magazine/newspaper, and posting on social networks (Schulz et al., 2018b). ICCS 
2022 continues to gather data reflecting teachers’ perceptions of activities related to 
environmental sustainability. 

Research has shown widespread use of ICT in secondary education, as well 
as considerable differences in the equipment of schools with ICT resources (see 
Fraillon et al., 2014, 2019; Law et al., 2008). ICCS 2022 asks principals about 
training activities undertaken at school, on the use of digital technologies for civic 
and citizenship education, and teachers about undertaking activities with target grade 
students related to a critical and responsible use of digital technologies for civic and 
citizenship education. 


4.3.4 Teaching of Civic-Related Subjects 


As in previous cycles, the ICCS 2022 teacher questionnaire includes an international 
option with questions about civic and citizenship education at school and the teaching 
practices the teacher adopted in this learning area. This part of the questionnaire is 
only completed by teachers of subjects that national centers defined as related to civic 
and citizenship education by considering their national curricula for this learning 
area. 

Studies have shown that teacher preparation is one of the most important factors 
influencing student achievement (see OECD, 2009, 2015). Within civic and citizen- 
ship education, the provision of teacher training constitutes an ongoing challenge for 
educational policies, as in many countries no specific training is provided to teachers 
in this area (Birzea et al., 2004; European Commission/EACEA/Eurydice, 2005). 
Following a classification developed by Shulman (1986, 1987), teacher knowledge 
may either be related to topics in the area of civic and citizenship education (content 
knowledge), or to teaching methods and approaches (pedagogical knowledge) of 
which there are a wide range of in this learning area (Munn et al., 2012). ICCS 2016 
included a question on teachers’ participation in professional development activities 
relating to the teaching of civic and citizenship education and ICCS 2022 continues 
to collect data on teachers’ self-reported initial preparation and in-service training 
to teach civic-related topics and their attendance at training courses on teaching 
approaches and methods. 

Results from ICCS 2009 showed that teachers of civic-related subjects tended 
to be most confident about teaching citizens’ rights and responsibilities, and human 
rights, while they were less confident in teaching topics related to the economy, busi- 
ness, and legal institutions (Schulz et al., 2010). Results from ICCS 2016 suggested 
that, on average, most teachers felt very well or reasonably well prepared to teach 
almost all the topics and skills they were asked about. As in ICCS 2009, the highest 
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average percentages across countries were recorded for teaching “citizens’ rights and 
responsibilities” and “equal opportunities for men and women”. The lowest percent- 
ages were recorded for teaching “the global community and international organiza- 
tions” and “the constitution and political systems”. The study also found evidence 
of large variation in these percentages across participating countries. ICCS 2022 
continues to gather data on teachers’ sense of preparedness to teach civic-related 
topics. A question using the same teaching topics, aims to measure teachers’ reports 
on opportunities to learn about civic-related topics students at the target grade have 
at school. 

It has been suggested that the delivery of civic and citizenship education should 
entail innovative pedagogies, engaging and interactive learning environments, and 
the use of different sources to develop students’ knowledge skills and attitudes 
related to this area of learning (Council of Europe, 2018; European Commis- 
sion/EACEA/Eurydice, 2017). ICCS 2016 asked teachers about their use of specific 
training methods during their lessons in civic-related subjects. ICCS 2022 continues 
to ask teachers about their civic-related teaching and learning activities in their class- 
rooms (such as “interactive teaching,” “traditional teaching,” and discussing contro- 
versial issues) and about the use of different sources in the planning of civic and 
citizenship education. In addition to this, the ICCS 2022 teacher questionnaire also 
includes a question focused on teacher reports on classroom activities that address 
global issues (such as collective engagement to achieve worldwide improvements or 
social and economic interactions at the international level). 

Assessment is a complex issue for civic and citizenship education: the wide range 
of learning objectives and topics included in this area and the different contexts and 
approaches for its delivery, imply the need to adopt different assessment methods to 
measure students’ knowledge, skills, the development of values and attitudes, and 
their active engagement in school life and in the local community (European Commis- 
sion/EACEA/Eurydice, 2012, 2017; Torney-Purta et al., 2015). The ICCS 2009 and 
2016 teacher questionnaires included a question about the use of different assess- 
ment tools in the teaching of civic and citizenship education. ICCS 2022 continues 
to gather this information as part of its teacher survey. 


4.4 The Home and Peer Context 


There are many variables related to home and peer contexts that potentially could 
influence the development of young people’s knowledge, attitudes, and dispositions 
for engagement. Relevant factors include interactions with family and peers, educa- 
tional resources in the home (including digital technologies), culture, religion, values, 
use of the test language at home, the relationship status the young person has within 
the family, parental education, income and employment levels, access to different 
forms of media, and the quality of school—home connections. Furthermore, it is also 
important to consider opportunities for civic-related activities that young people can 
exercise. 
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4.4.1 Family Background 


Numerous research findings have emphasized the crucial role family background 
plays in the development of dispositions toward engagement and participation of 
young people in citizenship activities (Bengston et al., 2002; Ekman & Zetterberg, 
2011; Grusec & Kuczynski, 1997; Janoski & Wilson, 1995; Lauglo, 2011; Renshon, 
1975; Vollebergh et al., 2001). There is a general consensus that family background 
influences the political development of adolescents (Castillo et al., 2014; Sherrod 
et al., 2010). Higher levels of socioeconomic background can potentially provide a 
more stimulating environment for developing civic-related dispositions and enhance 
the educational attainment of adolescents. These factors, in turn, foster political 
involvement. 

Many studies of political socialization and participation have highlighted the 
importance of the extent to which families and individuals can access different 
forms of capital. According to Bourdieu (1986), economic capital can increase other 
forms of capital, and it is possible to distinguish between human, cultural, and social 
capital. Whereas human capital refers to an individual’s skills, knowledge, and qual- 
ifications, cultural capital refers to those “widely shared, high-status cultural signals 
(attitudes, preferences, formal knowledge, and behaviors) used for social and cultural 
exclusion” (Lamont & Lareau, 1988, p. 156). Social capital is conceptualized as a 
societal resource that links citizens to one another so that they can achieve goals 
more effectively (see Stolle, 2002). 

Putnam (1993, p. 185) viewed social capital as the “key to making democracy 
work” and built on Coleman’s (1988) concept of social capital as being generated by 
the relational structure of interactions inside and outside the family, which in turn 
facilitate the success of an individual’s actions as well as learning outcomes. Putnam 
(1993) regarded three components of social capital (social trust, social norms, and 
social networks) as a “virtuous cycle” that provides a context for an individual’s 
successful cooperation with others and participation in a society. 

The concept of social capital has been criticized for its lack of clarity (Woolcock, 
2001) given the wide range of factors it includes and the problems of establishing 
suitable indicators. Within the context of ICCS, however, the concept of social capital 
is viewed as helpful because it describes mechanisms that help to explain why some 
students have higher levels of civic knowledge and engagement than others. Measures 
of different aspects of social capital (trust, norms, and social interaction) include both 
attitudinal and background variables. Some variables reflecting social capital are 
related to the home environment, in particular interactions with parents, peers, and 
media. Other relevant variables are interpersonal trust and voluntary participation in 
civic-related organizations (Chap. 3, Civic Attitudes and Engagement Framework). 


3 Putnam’s view of social capital, however, is narrower and more specific than Coleman’s concept. 
Putnam saw social capital as a collective resource and stated that horizontal interactions tend to 
foster trust and participation, whereas vertical relationships lead to distrust and disengagement 
(Stolle, 2002). 
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Variables related to the home environment that are antecedents of student learning 
and development and are measured through the student background questionnaire 
include: (i) parental socioeconomic status, (ii) cultural and ethnic background, (iii) 
parental interest in political and social issues, and (iv) family composition. As in 
previous cycles, ICCS 2022 collects data on process-related variables that reflect 
social interactions outside of school (for example, discussing political and social 
issues with parents and peers, as well as accessing information through media). 


Socioeconomic status 


Socioeconomic status (SES) is widely regarded as an important explanatory factor 
that influences learning outcomes in many different and complex ways (Sirin, 2005). 
There is a general consensus that SES is represented by income, education, and 
occupation (Gottfried, 1985; Hauser, 1994) and that using all three variables is 
better than using only one indicator (White, 1982). However, there is no consensus 
among researchers regarding which measures should be used in any one analysis 
(Entwistle & Astone, 1994; Hauser, 1994) and there have been calls for a more 
theory-based approach to the measurement of SES (Harwell, 2018). In international 
studies, the additional caveats imposed on the validity of background measures and 
the cross-national comparability of family background measures present ongoing 
challenges for researchers in this area (see Buchmann, 2002; Brese & Mirazchiyski, 
2013; Caro & Cortés, 2012). 

There is evidence from national studies of civic and citizenship education that 
student’s civic knowledge is positively associated with their socioeconomic home 
background (ACARA [Australian Curriculum, Assessment & Reporting Authority], 
2017; Lutkus & Weiss, 2007; Niemi & Junn, 1998). Similarly, international studies 
of civic and citizenship education conducted by the IEA illustrated the consistent 
relationship between socioeconomic background and civic learning (Torney et al., 
1975; Torney-Purta et al., 2001; Schulz et al., 2010, 2018b). As in previous study 
cycles, the student questionnaire for ICCS 2022 includes three different types of data 
collection to measure the students’ parental socioeconomic background: 


e Data on parental occupation are collected through open-ended student reports 
on mother’s and father’s jobs and coded according to the International Stan- 
dard Classification of Occupations (ISCO-08) framework (International Labour 
Organisation, 2012). Subsequently, the codes will be scored using the international 
socioeconomic index (SEI) of occupational status, in order to obtain measures of 
socioeconomic status (Ganzeboom et al., 1992). 

e Dataon parental education are collected through closed questions in which educa- 
tional levels are defined by the International Standard Classification of Education 
(ISCED-2011) (UNESCO, 2012b) and then adapted to the national context. 

e Data on home literacy environment are collected through a question about the 
number of books at home. 
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Cultural and ethnic background 


International studies have confirmed differences based on language and immigrant 
status in reading (see, for example, Elley, 1992; Stanat & Christensen, 2006) and 
mathematics (Mullis et al., 2000). Research in Western industrialized countries has 
shown that students from immigrant families, especially those who have arrived 
recently, may tend to lack proficiency in the language of instruction and are unfamiliar 
with the cultural norms of the dominant culture. However, studies have also shown 
that these effects strongly depend on the national contexts. Research also suggests 
that immigrant status, ethnic background, and language can have effects on learning 
outcomes even after controlling other contextual variables such as socio-economic 
background (see, for example, Dimitrova et al., 2016; Dronkers et al., 2012; Fuligni, 
1997; Kao, 2001; Lehmann, 1996; Schulz et al., 2010; Stanat & Christensen, 2006). 
Results from ICCS 2009 and 2016 showed that immigrant background and language 
use were both associated with civic- related learning outcomes, in particular, in 
countries with relatively large proportions of immigrant students (see Schulz et al., 
2010, 2018b). ICCS 2022 continues to collect data on the cultural/ ethnic background 
in its student questionnaire: 


© Country of birth (mother, father, and student): This information can be used to 
distinguish “native,” “first-generation” (parents born abroad, but student born in 
country), and “immigrant” (student and parents born abroad) students. 

e Language of use at home: Students are asked which language they use mainly at 
home, and responses provide an indicator of the dominant use of the assessment 
language or another language. 

© Students’ use of multiple languages at home: Students are asked whether they use 
more than one language at home (optional question for countries). 

© Student self-reports on ethnicity: Students are asked whether they belong to ethnic 
groups that exist in society (optional question for countries). 


Parental interest in political and social issues 


There is evidence that parental involvement may play a role in mediating socioeco- 
nomic inequalities in its effect on promoting young people’s learning (Caro, 2018). 
With regard to civic learning, it has also been shown that those students whose parents 
engage with them in discussions about political and civic issues tend to have higher 
levels of civic knowledge and engagement (see, for example, Lauglo & @ia, 2008; 
Richardson, 2003). The ICCS 2009 survey asked students to assess the extent of their 
parents’ interest in political and social issues, and results showed positive associa- 
tions with some learning outcomes, particularly those related to expected political 
engagement as adults (Schulz et al., 2010, 2015). ICCS 2016 included the same ques- 
tion, complemented by an item measuring the students’ own interest in political and 
social issues, and data showed associations with several indicators of engagement 
(Schulz et al., 2018b). ICCS 2022 continues to gather data about parental interest in 
political and social issues using the same items as in the previous cycle. 
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Family composition 


Family structure represents an important factor of socialization that may affect 
learning outcomes. For example, research in the United States has shown that students 
from single-parent families perform less well on measures of achievement than those 
from two-parent households, a finding which has been interpreted as being associ- 
ated with economic stress and lack of human or social capital in the household 
(McLanahan & Sandefur, 1994; Seltzer, 1994). However, the effects of single-parent 
upbringing on learning outcomes have been generally considered as relatively small 
(for a review, see Ginther & Pollak, 2004; Marjoribanks, 1997). 

Using a question that was an option for countries, ICCS 2009 and 2016 measured 
family composition by asking students about the composition of their respective 
household, that is, parents, guardians, siblings, relatives, and/or other persons. As in 
the previous surveys, the same question (with modifications) continues to be included 
as an international option in the ICCS 2022 student questionnaire. 


4.4.2 Student Activities Out of School 


Students’ discussion of political and social issues with parents and peers 


Research has shown associations between the frequency of political discussions 
and learning outcomes (Lauglo, 2011; Richardson, 2003; Schulz, 2005). Analyses 
of ICCS 2009 and 2016 data also suggested associations between the frequency of 
participation in discussions about political and social issues, civic knowledge, as well 
as civic interest (Lauglo, 2016; Schulz et al., 2010, 2018b). The ICCS 2022 student 
questionnaire continues to collect data on the level of political communication among 
lower-secondary students. 


Media information 


One popular explanation for the waning of civil society in the United States is the 
negative effect of television viewing (Putnam, 2000), which, it is argued, leads to 
decreasing interest, sense of efficacy, trust, and participation (see also Gerbner, 1980; 
Robinson, 1976, Van Aelst, 2017). However, research also shows that media use (in 
particular, for accessing information) tends to be positively related to political partic- 
ipation and that there is no conclusive evidence for a negative relationship between 
media use and political participation or political trust (Aarts et al., 2012; Norris, 
2000). More recent research indicates that use of social media has more consistent 
effects on political mobilization than television (see, for example, Boulianne et al., 
2020). Further, there is evidence that while consumption of news from informa- 
tion/news websites tends to be associated with higher levels of political trust, use of 
social media for information is linked to lower trust levels (Ceron, 2015). 

Data from the CIVED study in 1999 showed that media information obtained 
from television news reports is a positive predictor of civic knowledge and indi- 
cates expected participation in elections (Torney-Purta et al., 2001). ICCS 2009 
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results also suggested that students’ civic knowledge was positively associated with 
viewing television news, reading newspapers, and getting information from the 
internet (Schulz et al., 2010). The student questionnaire for ICCS 2016 included 
several items measuring the frequency of students’ use of media to obtain informa- 
tion about political and social issues. [CCS 2016 results showed decreases in the use 
of newspapers as a way of accessing information, since 2009 (Schulz et al., 2018b). 
ICCS 2022 includes items designed to measure students’ use of media for obtaining 
information about civic-related issues. Given its more active nature, students’ civic 
involvement through social media is described as an indicator of engagement in civic 
attitudes and engagement framework (Chap. 3). 


Students’ use of digital devices 


Given the increasing importance of ICT for civic engagement, it is also of interest to 
gather information about the frequency with which students use digital devices. Data 
derived from this type of question may be influenced by family background and home 
resources (see Fraillon et al., 2014, 2019). The ICCS 2022 student questionnaire 
includes an optional question asking about students’ frequency of using different 
types of digital devices (computer, tablets, and smartphones) at home. 


Religious affiliation and engagement 


Researchers have suggested that religious affiliation may help to foster political and 
social engagement (see Guo et al., 2013; Perks & Haan, 2011; Verba et al., 1995), 
because religious organizations provide networks focused on political recruitment 
and motivation. However, there is also evidence for negative effects of religious affil- 
iation on democratic citizenship, as reflected in lower levels of political knowledge 
and engagement, and feelings of efficacy among strongly religious people (Porter, 
2013; Scheufele et al., 2003). In the case of young people, religious affiliation and 
participation can be seen as part of the home environment that may influence the 
process of civic-related learning. 

Results from ICCS 2009 and 2016 showed that students reporting more frequent 
attendance of religious services were more supportive of religious influence in society 
(Schulz et al., 2010, Schulz et al., 2018b). As part of its international option about 
religion, ICCS 2022 continues measuring students’ religious affiliation and students’ 
attendance at religious services using the same questions as in the two previous 
survey cycles. 


4.5 Student Characteristics 


Individual students’ development of civic understandings, attitudes, and dispositions 
can be influenced by a number of characteristics, some of which link to family 
background. Antecedents at this level, collected through the student questionnaire, 
include age, gender, and expected educational qualifications. 
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Students’ age 


Research has found that, during adolescence, civic knowledge and (at least some 
forms of) engagement increase with age (Amadeo et al., 2002; Hess & Torney, 
1967). However, there is also evidence that feelings of trust in the responsiveness 
of institutions and willingness to engage in conventional forms of active political 
participation decrease toward the end of secondary school (Schulz, 2005). ICCS 
2009 and 2016 confirmed earlier cross-sectional research based on data from within 
grade sample data, which showed age to be negatively correlated with students’ civic 
knowledge, particularly in countries with higher rates of grade repetition, because 
the students in the class who are older are typically those who have repeated a grade 
because of previous low achievement (Schulz et al., 2010). While the study is not 
designed to address age effects on the development of civic knowledge, attitudes, 
and engagement, ICCS 2022 continues to gather data about students’ age as part of 
the collected information on their background. 


Students’ gender 


The first IEA Civic Education Study in 1971 found considerable differences between 
male and female students regarding cognitive achievement, with male students 
tending to have higher civic knowledge scores (Torney et al., 1975). The IEA’s 1999 
CIVED survey, however, presented a different picture: whereas in some countries 
males showed (slightly and not significantly) higher average scores, in other countries 
females were performing better (although only one country reported the difference 
as significant). Interestingly, greater differences in favor of males were found in the 
follow-up study of upper secondary students (Amadeo et al., 2002). CIVED also 
showed that differences between male and female students were usually larger on 
indicators of civic engagement: in most countries, males tended to have higher levels 
of political interest and expected participation. Gender differences were also impor- 
tant with regard to attitudes toward immigrants’ and women’s rights (Amadeo et al., 
2002; Torney-Purta et al., 2001). 

ICCS 2009 showed a difference in favor of female students having higher civic 
knowledge scores (Schulz et al., 2010), which was a change from CIVED 1999. This 
change might be interpreted as associated with the broadening of the assessment 
framework to include a greater emphasis on aspects of reasoning. Similar differences 
in the civic knowledge of male and female students were reported in ICCS 2016 
(Schulz et al., 2018b). ICCS 2009 and 2016 also confirmed findings from CIVED 
1999 that showed gender differences for indicators of civic attitudes and engagement 
(Fraillon et al., 2014; Kerr et al., 2010; Schulz et al., 2010, 2011, 2018b). ICCS 2022 
continues to gather data about students’ gender. However, in view of possible changes 
in requirements for the collection of information about gender, countries will have 
the option of adapting this question by including a third gender category. 


Students’ expected educational attainment 


In the first two IEA studies of civic education, expected years of future education 
were important predictors of civic knowledge (Amadeo et al., 2002; Torney et al., 
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1975, 2001). This variable reflects individual aspirations. However, responses can 
also be influenced by parent or peer expectations and/or, in some education systems, 
by limitations brought about by students studying in programs that do not give access 
to university studies. 

ICCS 2009 and 2016 used a similar question that asked students to indicate their 
expected level of education. Results from the two first ICCS cycles confirmed that this 
variable is positively associated with civic knowledge (Schulz et al., 2010, 2018b). 
The ICCS 2022 student questionnaire includes the same question as previous ICCS 
surveys to gather data about students’ educational aspirations. 
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Chapter 5 A) 
Assessment Design get 


5.1 The ICCS 2022 Instruments 


The ICCS 2022 instruments collect outcome data, as well as contextual variables. 
Given the specific nature of a study on civic and citizenship education, outcome 
variables are assessed through cognitive test materials and a student questionnaire. 
Contextual data that explain variation in outcome variables are collected through 
student, teacher, and school questionnaires, as well as through the national contexts 
survey. 

Table 5.1 shows the instruments used in ICCS 2022 together with their respective 
assessment mode (computer-based assessment = CBA; paper-based assessment = 
PBA), length and type of respondent. For student instruments, countries chose the 
standard assessment mode (computer or paper) for all respondents. For teacher and 
school questionnaires, countries decided for each instrument whether to administer 
them only on paper, only in online mode, or depending on the respondent’s prefer- 
ence, in either of the two modes. The national contexts survey was only offered in 
online format to national centers. 

The ICCS 2022 test of civic knowledge also includes 55 items from five clusters 
that were used in ICCS 2016 in order to estimate changes over time for those countries 
participating in both surveys. These 55 items were integrated across the eleven ICCS 
2022 test item clusters (comprising 121 items in total) that are common to both 
computer-based and paper-based assessments. This was done to ensure an appropriate 
content balance within each cluster given that, for this cycle, approximately one- 
half of the newly developed items related to two areas of increased focus: global 
citizenship and sustainable development. Larger numbers of items reflecting these 
two areas have also been included in the student, teacher, and school questionnaires. 

The computer-based test instrument included three clusters of items in addition 
to the eleven clusters common to both the computer-base and paper-based tests. The 
computer-based test instrument consequently comprised 14 clusters and the paper- 
based instrument comprised 11 clusters. Each of the three clusters of items, unique 
to the computer-based instrument, comprised five items associated with a narrative 
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Table 5.1 ICCS 2022 instruments 


Instrument Mode Length Respondent 
International cognitive test CBA or PBA 45 min Student 
International student questionnaire CBA or PBA 40-50 min Student 
European questionnaire CBA or PBA ~20 min Student 
Latin American questionnaire CBA or PBA ~10 min Student 
Teacher questionnaire Online and/or paper ~30 min Teacher 
School questionnaire Online and/or paper ~30 min Principal 
National contexts survey Online N/A NRC 


Note NRC national research coordinator or designate 


theme. In each cluster, at least one item provided some form of dynamic feedback 
to students that could not be achieved in a paper-based testing environment. 

Table 5.2 shows the numbers and percentages of items from ICCS 2016 and those 
newly developed for ICCS 2022. For the student test and the European student ques- 
tionnaire more than half of the item material was newly developed for the third ICCS 
cycle. For the teacher and school questionnaires slightly less than half of the content 
was added in ICCS 2022. For the student questionnaire, about one third of the item 
material addresses the areas of global citizenship and sustainable development. Due 
to delays with the implementation of the field trial in all Latin American ICCS 2022 
countries caused by the COVID-19 pandemic, no field trial data were available for 
an evaluation of newly developed item material for the ICCS 2022 Latin Amer- 
ican student questionnaire. For this reason, this regional instrument consists almost 
entirely of material that was included in the previous cycle. 


Table 5.2 Numbers and percentages of items from ICCS 2016 and those newly developed for 
ICCS 2022 contained within the main survey instruments 


Instruments ICCS 2016 link items | New ICCS 2022 items | Total 
International student test (PBA) 55 (45%) 66 (55%) 121 
International student test (CBA) 55 (40%) 81 (60%) 136 
International student questionnaire 125 (68%) 60 (32%) 185 
European student questionnaire 42 (48%) 46 (52%) 88 
Latin American student questionnaire 38 (84%) 7 (16%) 45 
International teacher questionnaire 54 (55%) 45 (45%) 99 
International school questionnaire 75 (58%) 54 (42%) 129 


Note The table does not include optional instrument parts (such as questions for teachers of civic— 
related subjects or other optional items). The ICCS 2022 new CBA test items comprise 66 items 
common to the PBA test and 15 items unique to the CBA test 
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5.2 Item Types 


The ICCS 2022 instruments include a range of different item types in order to assess 
a diversity of cognitive, affective-behavioral or contextual aspects, which vary across 
instruments. 

The cognitive test contains the following item types: 


e Multiple-choice items (MC): Each item has four response options, one of which 
is the correct response and the other three of which are distractors. 

© Open-ended response items (OR): Students are requested to write a short response 
to an open-ended question. The responses are scored by scorers working for the 
national centers according to international scoring guides. 

e Drag & Drop items (DD): Students are requested to drag elements within a 
computer-based environment and drop them in other places in response to a 
question. 

e Large-task items (LT): Students provide answers by selecting different options 
on a computer in response to more complex tasks (e.g., through putting together 
web-page information) and receive some form of dynamic feedback based on 
their selections. 


Table 5.3 illustrates the distribution of item formats in the ICCS 2022 survey. 
For this cycle, the option for a computer-based delivery also includes a number 
of computer-enhanced items that are only delivered on a computer and will not be 
comparable with any paper-based items. For items in clusters that are common across 
both delivery modes (computer- and paper-based) about 10 percent of the items are 
constructed response items and 90 percent have a multiple-choice format, DD and 
LT formats are only found as part of the computer-enhanced items that also include 
items with an MC or CR format. 

As in ICCS 2009 and ICCS 2016, the student, teacher, and school questionnaires 
for ICCS 2022 include the following item types that were displayed in similar ways 
on both computer and on paper: 


e Likert-type items (LK): For each item, respondents are asked to rate a number 
of statements, typically on a four-point scale. For most of these items, the rating 
scale ranges from (1) strongly agree to (4) strongly disagree. The rating scales for 


Table 5.3 Item formats in 
the ICCS 2022 student test 


Item format Common items across | Computer-enhanced 
modes items 
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other questions indicate frequencies (never, rarely, sometimes, often) or levels of 
interest, trust, or importance. 

e Multiple-response items (MR): Respondents are asked to indicate the three aspects 
they view as most important. 

© Categorical response items (CR): Respondents are required to choose one out 
of two or more response categories that they view as most appropriate. These 
questions are primarily used for collecting contextual information (for example, 
on gender, educational level of parents, books in the home, subjects taught at 
school, and public or private school management). 

© Open-ended response items (OR): Respondents are asked to write a short 
response that is coded by the national centers; these items are used only for 
collecting information on parental occupation as part of the international student 
questionnaire. 


5.3 Coverage of Framework Domains 


The ICCS 2022 item material was developed to provide adequate coverage of the 
different types of domains and areas specified in the assessment framework. Given 
that in ICCS 2022 there are distinct frameworks for cognitive and affective-behavioral 
measures, the coverage is reviewed separately for each of these two types of measures. 

The coverage of cognitive and content domains shown in Table 5.4 illustrates 
how many of the items in both paper-based assessments (PBA) and computer-based 
assessments (CBA) relate to each cognitive and content domain. The highest number 
of items is related to the content domain civic principles, followed by civic institutions 
and systems and civic participation, while the lowest number of items is related to 
civic roles and identities. About two thirds of the common items relate to the cognitive 
domain reasoning and applying and one third to knowing. The 15 computer-enhanced 
items are all related to the content domain civic participation and the cognitive 
domain reasoning and applying. 


Table 5.4 Coverage of cognitive and content domains in ICCS 2022 test 


Civic Civic Civic Civic roles and Total in 
institutions principles participation identities cognitive 
and systems domain 

Knowing 9 22 5 6 42 

Reasoning and 21 29 PBA: 22 7 PBA: 79 
applying CBA: 38 CBA: 95 
Total in content 30 51 PBA: 27 13 PBA:121 
domain CBA: 43 CBA: 137 


Note Where not displayed separately, item numbers are equal for CBA and PBA 


5.4 The ICCS 2022 Test Design and the Described Achievement Scale 99 


Table 5.5 Coverage of affective-behavioral areas and subareas in the ICCS 2022 student question- 
naires 


Affective-behavioral International student | European student | Latin American student 
areas and subareas questionnaire questionnaire questionnaire 
Attitudes 

Attitudes toward civic 24 24 30 
principles 
Attitudes toward civic 49 41 7 
issues and institutions 
Attitudes toward civic 13 18 8 
roles and identities 

Engagement 
Experiences with 17 - - 
engagement 
Dispositions toward 8 - - 
engagement 
Expected future 26 - = 
engagement 


Note Optional items are not included 


Table 5.5 illustrates the coverage of affective-behavioral areas across the three 
student questionnaires (international, European, and Latin American). Within the 
area attitudes, for both the international and European student questionnaires, most 
items relate to the subarea attitudes toward civic issues and institutions, in the Latin 
American questionnaire most items pertain to the subarea attitudes toward civic 
principles. Generally, the subarea attitudes toward civic role and identities has some- 
what less coverage across instruments. For the area engagement, most items reflect 
expected future engagement, followed by experiences with engagement, while the 
lowest number of items is related to dispositions toward engagement. 


5.4 The ICCS 2022 Test Design and the Described 
Achievement Scale 


For the student test, ICCS 2022 uses rotated designs for test administration, making 
it possible to include more test material and thus ensure greater coverage of the 
assessment framework without increasing the testing time for each student. This 
procedure also enables enough score points to be generated to provide the basis 
for comprehensive descriptions of the scale. Rotating the clusters throughout the 
booklets (or modules when delivered on a computer) ensures that the different tests 
are linked. 

In countries conducting paper-based delivery, eleven test clusters are administered 
in a rotated design across eleven booklets, with each cluster appearing in one of the 
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three possible positions at the beginning, in the middle, or at the end of the booklet 
(Table 5.6). The design for computer-based delivery follows the same principles, 
however, only 14 clusters are administered (including three clusters consisting of 
computer-enhanced items, displayed on a shaded background in Table 5.7), each 
also appearing once in each of the three possible positions (Table 5.7). 

As ICCS 2022 is the first cycle of ICCS to include computer-based administration, 
itis necessary to review and adjust for mode effects across paper-and computer-based 


er iia er E eee poner Ewe 

assessment) First Second Third 
1 Cl C2 C6 
2 C2 C3 C7 
3 C3 C4 C8 
4 C4 c5 C9 
5 c5 C6 C10 
6 C6 C7 Cll 
7 C7 C8 Cl 
8 C8 C9 C2 
9 C9 C10 C3 
10 C10 Cll C4 
11 Cll Cl C5 

Sane a survey iest Booklet Position 

(computer-based assessment) First Second Third 
1 Cl C12 C9 
2 C2 C13 C10 
3 C3 C14 C11 
4 C4 Cl C12 
5 c5 C2 C13 
6 C6 C3 C14 
7 C7 C4 C1 
8 C8 CS C2 
9 C9 C6 C3 
10 C10 C7 C4 
11 Cll C8 c5 
12 C12 C9 C6 
13 C13 C10 C7 
14 C14 Cll C8 
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Table 5.8 Main survey test 


booklets design (bridging Booklet Position 
study) | First Second | Thid 
1 C1 c2 C4 
2 C2 C3 C5 
2 C3 c4 C6 
4 C4 C5 C7 
5 C5 c6 C8 
3 có c7 Cl 
7 C7 C8 C2 
8 C8 Cl C3 


delivery (both across ICCS 2022 participants and compared to the paper-based assess- 
ment in ICCS 2016). After a first review using data from a mode-effects study as part 
of the ICCS 2022 field trial, results showed some limited mode effects. Consequently, 
it will be necessary to confirm these results and provide a basis for estimating potential 
adjustments to make data across modes fully comparable. Therefore, the ICCS 2022 
main survey includes a bridging study: In countries completing the computer-based 
assessment that also participated in the previous cycle, an additional separate sample 
of students complete the test on paper. The paper-based test instrument used in the 
bridging study comprises only the first eight clusters of the paper-based assessments, 
which are administered in a similarly rotated design (Table 5.8). 

Test items will be scaled using IRT (item response theory) (Bond & Fox, 2007; 
Hambleton et al., 1991) specifically with the One-Parameter Rasch model (Rasch, 
1960). The cognitive test items for ICCS 2022 will be scaled to obtain civic knowledge 
scores. This scale will cover student knowledge and understanding encompassing the 
four content domains (civic systems and society, civic principles, civic participation, 
and civic roles and identities) and the two cognitive domains (knowing and reasoning 
and applying). Items will be used to describe students’ knowledge and understanding 
at different levels of student proficiency. ICCS 2016 trend items will provide the basis 
for equating civic knowledge scores across cycles. 

As in the previous survey cycles, ICCS 2022 test items were designed to provide 
the basis for deriving a described scale of civic knowledge, which has consisted, 
since ICCS2016, of four levels of proficiency. The proficiency-level descriptions are 
syntheses of the item descriptors within each level. They describe a hierarchy of civic 
knowledge in terms of increasing sophistication of content knowledge and cognitive 
process. Because the scale was derived empirically rather than from a specific model 
of cognition, increasing levels on the scale represent increasingly complex content 
and cognitive processes as demonstrated through performance. The scale does not, 
however, simply extend from simple content at the bottom to reasoning and analyzing 
at the top. 

The cognitive processes of knowing and of reasoning and applying can be seen 
across all four levels of the scale, depending on the content issues to which they 
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apply. The scale includes a synthesis of the common elements of civic and citizen- 
ship content at each level and the typical ways in which students use that content. 
Each level of the scale references the degree to which students appreciate the inter- 
connectedness of civic systems, as well as the sense students have of the impact 
of civic participation on their communities. The scale broadly reflects development 
encompassing the concrete, familiar, and mechanistic elements of civics and citizen- 
ship through to the wider policy and institutional processes that determine the shape 
of our civic communities, with the following four levels (see Appendix C for a more 
detailed description): 


e Level D: Students with civic knowledge at this level are expected to demonstrate 
basic familiarity with concrete, explicit content and examples relating to the basic 
features of democracy, to identify intended outcomes of simple examples of rules 
and laws, and to recognize the explicit function of key civic institutions and the 
rights of others. 

e Level C: Students with civic knowledge at this level are able to understand funda- 
mental principles and broad concepts underpinning civics and citizenship, are 
familiar with some of the “big ideas” of civics and citizenship, recognize social 
justice issues in familiar contexts, and demonstrate an understanding of the basic 
operations of civic and civil institutions. 

e Level B: Students with civic knowledge at this level are expected to demonstrate 
specific knowledge and understanding of the most pervasive civic and citizen- 
ship institutions, systems, and concepts, and to understand the interconnectedness 
between civic and civil institutions as well as the processes and systems through 
which they operate. 

© Level A: Students with civic knowledge at this level demonstrate integrated rather 
than segmented knowledge and understanding of civic and citizenship concepts. 
They have the ability to make evaluative judgments with respect to the merits 
of specific policies and behaviors in view of different perspectives, to provide 
justifications for positions or propositions, and to hypothesize expected outcomes 
based on their understanding of civic and citizenship systems and practices. 


5.5 Questionnaire Scales 


ICCS 2022 will report on outcomes of civic and citizenship education and contexts 
based on several scales derived from the international and regional student ques- 
tionnaires and the teacher and school questionnaires. Typically, items will be scaled 
using the IRT Rasch partial credit model (Masters & Wright, 1997). 

The international student questionnaire includes items that will be used to obtain 
the following expected constructs (new aspects are displayed in italics): 
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Attitudes 


Students’ perceptions of the value of student participation at their schools (5 
items) 

Students’ attitudes toward the political system (9 items, two dimensions expected: 
cynicism and support for political system) 

Students’ perceptions of threats to democracy (9 items) 

Students’ perceptions of good citizenship (13 items, three dimensions expected: 
conventional behavior, social-movement-related behavior and global citizenship 
behavior) 

Students’ attitudes toward restrictions in national emergencies (9 items) 
Students’ attitudes toward equal rights for immigrants and non-immigrants (5 
items) 

Students’ attitudes toward gender equality (7 items) 

Students’ attitudes toward environmental protection (5 items) 

Students’ attitudes toward equal rights for all ethnic groups (international option, 
5 items) 

Students’ trust in institutions (14 items, six items for measuring construct: trust 
in Civic institutions) 

Students’ perceptions of threats to the world’s future (11 items) 

Students’ attitudes toward the influence of religion in society (international option, 
6 items) 


Engagement 


Students’ engagement with digital media (5 items) 

Students’ (past or present) involvement in organizations and groups outside of 
school (5 items) 

Students’ (past or present) involvement in school activities (7 items) 

Students’ sense of citizenship self-efficacy (7 items) 

Students’ expectations of future school participation (4 items) 

Students’ expectations to participate in civic action to express opinions about 
important issues (13 items, three dimensions expected: Expected legal activities, 
expected pro-environmental activities, expected illegal activities) 

Students’ expectations of participation as adults (10 items, two dimensions 
expected: expected electoral participation and expected active political partici- 
pation) 


Home and school contexts 


Students’ reports on media consumption and discussions about political and social 
issues (7 items, 4 items to measures political discussions with parents and peers) 
Students’ perceptions of open classroom climates for discussion of political and 
social issues (6 items) 

Students’ reports on civic learning at school (9 items) 
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Students’ perceptions of their school climate (9 items, two dimensions expected: 
perceptions of teacher-student relationships at school and perceptions of social 
interaction between students at school) 


The European regional student questionnaire includes items that will be used to 


obtain the following indices (new aspects are displayed in italics): 


Students’ sense of European identity (4 items) 

Students’ reports of learning opportunities about Europe at school (5 items) 
Students’ attitudes toward freedom of movement for European citizens within 
Europe (6 items, two dimensions expected: endorsement of freedom of movement 
and endorsement of restrictions) 

Students’ attitudes toward cooperation among European countries (7 items) 
Students’ attitudes toward environmental cooperation in Europe (5 items) 
Students’ perceptions of discrimination in Europe (10 items) 

Students’ expectations regarding the future of Europe (13 items, two dimensions 
expected: positive and negative perceptions) 

Students’ expectations regarding their own individual future (5 items) 

Students’ perceptions of the importance of aspects for their future life (9 items) 
Students’ reports of political and ethical consumerism behaviors (6 items) 
Students’ reports of their sustainable behaviors (8 items) 

Students’ attitudes toward the European Union (10 items) 


The Latin American regional student questionnaire includes items that will be 


used to obtain the following indices (new aspects are displayed in italics): 


Students’ perceptions of their own individual future (8 items) 

Students’ attitudes toward authoritarian government practices (7 items) 
Students’ attitudes toward corrupt practices (5 items) 

Students’ attitudes toward disobedience to the law (10 items) 

Students’ attitudes toward homosexuality (5 items) 

Students’ perception of discrimination of minorities in Latin American societies 
(10 items) 


The teacher questionnaire includes items to derive the following contextual indices 


(new aspects are displayed in italics): 


Teachers’ participation in school governance (6 items) 

Teachers’ perceptions of social problems at school (9 items) 

Teachers’ perceptions of student activities in the community (10 items) 
Teachers’ perceptions of classroom climate (4 items) 

Teachers’ perceptions of student participation in decision-making processes at 
classroom level (6 items) 

Teachers’ reports of activities to deal with diversity among students (6 items) 
Teachers’ perceptions of the effects of cultural and ethnic diversity on teaching 
and class contexts (6 items) 

Teachers’ perceptions of the effects of social and economic diversity on teaching 
and class contexts (6 items) 
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Teachers’ reports of activities related to environmental sustainability (6 items) 
Teachers’ reports of activities related to the use of digital technologies (4 items) 
Teachers’ perceptions of good citizenship (13 items, three dimensions expected: 
conventional, social-movement-related and global citizenship behavior) 

e Teachers’ reports of class activities related to civic and citizenship education 
(international option, 10 items) 

© Teachers’ reports of activities related to global issues (international option, 5 
items) 

e Teachers’ preparation for teaching topics related to civic and citizenship education 
(international option, 13 items) 

e Teachers’ reports of their participation in training courses about topics related to 
civic and citizenship education (international option, 13 items) 

e Teachers’ perceptions of students’ opportunities to learn about topics related to 
civic and citizenship education (international option, 13 items) 

e Teachers’ reports of their training in teaching methods (international option, 6 
items) 


The school questionnaire includes items to derive the following contextual indices 
(new aspects are displayed in italics): 


Principals’ perceptions of teacher participation in school governance (5 items) 
Principals’ perceptions of school community participation (10 items, two dimen- 
sions expected: students’ and parents’ participation in decision-making at 
school) 

e Principals’ perceptions student contributions to decision-making processes at 
school (5 items) 

© Principals’ reports on communication between school and parents/guardians (4 
items) 

© Principals’ reports of collaboration between the school and the local community 
(4 items) 

e Principals’ perceptions of student opportunities to participate in community 
activities (10 items) 
Principals’ reports of activities related to diversity at school (6 items) 
Principals’ reports of activities related to environmental sustainability (9 items) 
Principals’ reports of the extent to which activities related to global citizenship 
education and education for sustainable development (6 items) 

e Principals’ reports on training activities undertaken at school on the use of digital 
technologies for civic and citizenship education (6 items) 

e Principals’ perceptions of the availability of resources in the local community (11 
items) 
Principals’ perceptions of social tension in the community (12 items) 
Principals’ perceptions of school autonomy for the delivery of civic and citizenship 
education (7 items) 
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Laura Palmerio, data analyst 
International Association for the Evaluation of Educational Achievement (IEA) 


IEA provides overall support for the coordination of ICCS 2022 from both the 
Amsterdam and Hamburg offices. Staff at IEA Amsterdam are responsible for the 
coordination of translation verification, quality control monitoring, and the publica- 
tion and wider dissemination of the report. Staff at IEA Hamburg are responsible for 
the coordination of sampling procedures, and data management and processing. 


Staff at the IEA Amsterdam 

Julian Fraillon, coordinator of test development 
Dirk Hastedt, executive director 

Andrea Netten, director at the IEA Amsterdam 
Jan-Peter Broek, financial manager 

Jan-Philip Wagner, research officer 

Jasmin Schiffer, graphic designer 

Katerina Hartmanova, junior research officer 

Katie Hill, head of communications 

Lauren Musu, senior research officer 

Luiza Uerlings, junior graphic designer 

Philippa Elliott, publications manager 

Staff at the IEA Hamburg 

Alena Becker, co-head of international studies unit 
Christine Busch, ICCS deputy international data manager 
Diego Cortes, researcher (sampling) 

Falk Brese, ICCS international data manager 
Hannah Kowolik, [CCS international data manager 
Ralph Carstens, senior research advisor 

Sabine Weber, researcher (sampling) 

Umut Atasever, researcher (sampling) 

ICCS 2022 project advisory committee (PAC) 


The ICCS 2022 PAC has, from the beginning of the project, advised the international 
study center and its partner institutions during regular meetings. 


Babara Malak-Minkiewicz, IEA Amsterdam (retired), Netherlands 
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Cristian Cox, Diego Portales University, Chile 

Erik Amna, Orebro University, Sweden 

Judith Torney-Purta, University of Maryland, United States 

Wiel Veugelers, The University of Humanistic Studies Utrecht, Netherlands 
ICCS 2022 sampling referee 


Marc Joncas is the sampling referee for the study, providing invaluable advice on all 
sampling-related aspects of the study. 


ICCS 2022 National Research Coordinators (NRCs) 


The national research coordinators (NRCs) played a crucial role in the study’s devel- 
opment. They provided policy- and content-oriented advice on developing the instru- 
ments and were responsible for the implementation of ICCS 2022 in the participating 
countries. 


Brazil 

Aline Fernandes Muler 

The Instituto Nacional de Estudos e Pesquisas Educacionais Anisio Teixeira (INEP) 
Bulgaria 

Natalia Vassileva 

Center for Control and Assessment of the Quality in School Education 
Chile 

M. Victoria Martinez Muñoz 

Agencia de Calidad de la Educación 

Chinese Taipei 

Meihui Liu 

National Taiwan Normal University (NTNU) 

Colombia 

Natalia Gonzalez Gómez 

Colombian Institute for the Assessment of Education (ICFES) 

Croatia 

Ines Elezović 


Department for Quality Assurance in Education, National Centre for External 
Evaluation of Education 
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Cyprus 

Yiasemina Karagiorgi 

Centre for Educational Research and Evaluation 
Denmark 

Jens Bruun 

Danish School of Education, Aarhus University 
Estonia 

Meril Umarik 

Tallin University 

France 

Marion LeCam 

Ministry of National Education 

Germany (North Rhine-Westphalia and Schleswig-Holstein) 
Hermann Josef Abs 

University of Duisburg-Essen 

Katrin Hahn-Laudenberg 

Bergische Universität Wuppertal 

Italy 

Laura Palmerio 

INVALSI 

Latvia 

Ireta Čekse 

University of Latvia 

Lithuania 

Lina Pareigiene 

National Agency for Education 

Malta 

Louis Scerri 


Ministry for Education and Employment 
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Netherlands 

Remmert Daas 

University of Amsterdam 

Norway 

Norway Oddveig Storstad Instiutt for lærerutdanning 


NTNU (Department of Teacher Education, Norwegian University and Science and 
Technology) 


Poland 

Olga Wasilewska 

Educational Research Institute (IBE) 
Romania 

Catalina Ulrich 

University of Bucharest 

Serbia 

Tanja Trbojević 

Institute for Education quality and Evaluation 
Slovak Republic 

Gabriella Kopas 

National Institute for Certified Educational Measurements 
Slovenia 

Eva Klemenéié-Mirazchiyski 
Educational Research Institute 

Spain 

Gala Rios Junquera 

INEE 

Sweden 

Ellen Almgren 

Swedish National Agency for Education 


Appendix B 


Key Terms for Civic and Citizenship Content 
Domains 


Key terms used across all content domains 


Civic 


Refers to any community in which the shared connections between people are at 
a broader level than that of the extended family (including the state). Civic also 
refers to the principles, mechanisms, and processes of decision-making, 
participation, governance, and legislative control that exist in these communities 


Civil 


Refers to the sphere of society in which the shared connections between people 
are at a broader level than that of the extended family, but do not include 
connections to the state 


Community 


A group of people who share something in common (for example, history, 
values, loyalties, a common goal, location). In this framework, community 
membership includes membership based on externally defined criteria relating 
to the function of the community (such as attending a school as a student) and 
membership defined by individuals’ own belief of their membership (such as 
through identification with “like-minded” people regarding a political, religious, 
philosophical or social issue or through perceptions of shared attributes from 
gender identity through to humanity, relating to identification with the global 
community)! 


Globalization 


a. The legal status of being a citizen of a nation state or supranational legal 
community (for example, the European Union) 

b. The reality of individuals’ participation, or lack of participation, in their 
communities. The term “citizenship,” unlike the term “active citizenship,” does 
not assume certain levels of participation 

c. Individual’s citizenship identity or sense of belonging to a national or 
supranational entity 


Society 


A community defined by its geographical territory and within which the 
population shares a common culture (which may comprise and celebrate 
multiple and diverse ethnic or other communities) and way of life under 
conditions of relative autonomy, independence, and self-sufficiency 


' Note that a community may still contain a certain level of diversity. 
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Key terms related to Content Domain 1: Civic Institutions and Systems 


Accountability The requirement for representatives to answer to those they represent on the 
conduct of their duties and use of their powers. Accountability includes the 
assumption that representatives are able to accept responsibility for their 
failures and to take action to rectify them 

Constitution The fundamental rules or laws of principle governing the politics of a nation 


Decision-making 


or subnational body 


The formal and informal processes by which decisions are made within and 
among civil and state institutions 


Democracy 


Dissent 


The ICCS assessment framework accepts the broadest definition of 
democracy “as rule by the people.” This definition refers both to democracy 
as a system of governance and to the principles of freedom, equity, and sense 
of community that underpin democratic systems and guarantee respect for 
and promotion of human rights. Both representative democratic systems 
(such as national parliaments) and “direct democracy” systems (such as 
through referendums or systems used in some local community or school 
organizations) can be examined as democratic systems under the definition of 
democracy used in this framework 


In democratic societies, dissent is a central notion that allows for voicing 
opposition to, expressing disagreement with, or standing apart from, the 
policies or decisions of the governing body 


Globalization 


Governance 


The increasing international movement of commodities, money, information, 
and people; and the development of technology, organizations, legal systems, 
and infrastructures to allow this movement. The ICCS assessment framework 
acknowledges that a high level of international debate surrounds the 
definition, perceptions, and even the existence of globalization. Globalization 
has been included in the framework as a key concept for consideration by 
students. The definition is not a statement of belief about the existence or 
merits of globalization 


The act and the processes of administering public policy and affairs 


Negotiation 


The processes that underpin and are evident when reaching an agreement, and 
the use and necessity of using such processes as a means of decision-making 


Power/authority 


Listed together as concepts dealing with the nature and consequences of the 
right, or capacity, of bodies or individuals to make binding decisions on behalf 
of others and that these others are then required to accept and to adhere to 


Rules/law 


Listed together as the explicit and implicit prescriptions for behavior. Rules 
are those prescriptions that are not required to be and are therefore not 
enforced bya sovereign body. Laws are considered to be those prescriptions 
that are enforced by a sovereign body 


Sovereignty 


The claim of each individual state/nation to have the ultimate power in 
making political decisions relevant to that state/nation and recognition that 
this power underpins the operation and viability of international 
organizations, agreements, and treaties 


Trade 


The actions, laws and policies underpinning the exchange of capital, goods, 
and services between countries across their international borders 


(continued) 
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(continued) 


The economy Systems governing the production, distribution, and consumption of goods 


and services within states, including industrial regulation, trade, taxation, and 
government spending including on social welfare. Economic conditions are 
both a focus of civic decisions as well as a key aspect of the environment in 
which decisions about other policies are made 


Treaties Binding agreements under international law entered into by eligible bodies 


such as states and international organizations 


Key terms related to Content Domain 2: Civic Principles 


Climate change 


“A change of climate that is attributed directly or indirectly to 
human activity that alters the composition of the global 
atmosphere and that is in addition to natural climate variability 
observed over comparable time periods” (United Nations, 1992, 
p. 7) 


Concern for the common good 


The concept that the ultimate goal of civic and community 
action is to promote conditions that advantage all members of 
the community 


Equality 


The notion that all people are born equal in terms of dignity and 
rights regardless of their personal characteristics (such as 
gender, race, religion) 


Human rights 


A form of inalienable entitlement of all human beings that, for 
the purpose of the ICCS assessment framework, is framed by 
the contents of the United Nations Universal Declaration of 
Human Rights (United Nations, 1948) 


Renewable energy 


For ICCS, renewable energy is defined as an energy source or 
fuel type that can regenerate and replenish itself virtually 
indefinitely, and is made available for use in ways that do not 
consume the Earth’s natural resources or otherwise do damage 
to the environment. Renewable energy sources include biomass, 
wind, hydro, solar and geothermal 


Safety and security 


The concept that people have the right to be protected, and to 
feel protected in situations of vulnerability 


Separation of powers 


The concept that three branches of government (executive, 
legislative, judicial) are kept separate (independent) from each 
other to prevent abuse of power and establish a system of checks 
and balances between these branches 


Social equity The concept that society has a moral imperative to support fair 
and equal access and treatment of citizens by the law, social 
services and benefits, and political agency 

Social justice The distribution of advantage and disadvantage within 


communities 


(continued) 


? This definition is the one adopted by the United Nations Framework Convention on Climate 
Change and has been adopted for ICCS because of its international status and its reference to 
change associated with human activity. 
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The welfare state 


The role of a government in providing for the social and 
economic security of its people through support such as health 
care, pensions, and social welfare payments and benefits 


Key terms related to Content Domain 3: Civic Participation 


Civic engagement 


The notion that civic communities benefit from the active 
engagement of their citizens. Civic communities have a 
responsibility to facilitate active citizenship, and citizens have a 
responsibility to participate actively in their civic communities 


Co-operation/collaboration 


The concept that communities benefit most when their members act 
together in pursuing the common goals of the community. This 
definition allows for disagreement within communities about the 
best way to achieve their goals 


Digital citizenship 


Membership in a community defined by their use of information 
and communication technology (ICT) to engage in society, politics, 
and government 


Negotiation/resolution 


The concept that peaceful resolution of differences is essential to 
community well-being and is the best way to attempt settlements of 
differences in viewpoints among community members 


Key terms related to Content Domain 4: Civic Roles and Identities 


Civic and citizenship values 


Individuals’ central ethical and moral beliefs about their civic 
communities and their roles as citizens within their communities 


Cultural identity 


Individuals’ sense of the value and place of the cultures they 
associate with their communities in their own civic lives and the 
civic lives of the other members of their communities. 


Empathy 


Intellectually or emotionally taking the role or perspective of 
others 


Franchise/Voting 


Listed together, these concepts refer to the rights, responsibilities, 
and expectations of people to vote in formal and informal 
settings. These concepts also refer, more broadly, to issues 
associated with voting and voting processes, such as compulsory 
and voluntary voting, and secret ballots 


Gender identity 


Gender identity reflects a deeply felt and experienced sense of 
one’s own gender that can correspond to or differ from the sex 
assigned at birth 


Global citizenship 


Individuals’ sense of belonging to and concern about the global 
community and common humanity that transcends local and 
national boundaries. The concept of global citizenship 
“emphasizes political, economic, social and cultural 
interdependency and interconnectedness between the local, the 
national and the global” (UNESCO, 2015) 


Inclusiveness 


The concept that communities have a responsibility to act in ways 
that support all their members to feel valued as members of those 
communities 


(continued) 
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(continued) 


Nationalism 


The politicization of patriotism into principles or programs based 
on the premise that national identity holds precedence over other 
social and political principles 


Nation-building 


Patriotism 


The process of developing among the people of a nation some 
form of a unified sense of national identity, with the aim of 
fostering long-term harmony and stability. Within the parameters 
of the ICCS assessment framework, nation-building is assumed to 
be a dynamic ongoing process in all nations rather than a process 
associated only with newly independent nations 


An individual’s love for or devotion to their country (or 
countries), which can lead to a willingness to act in support of 
that country (or countries) 


Positive change 


The concept that civic participation is motivated by the desire to 
improve aspects of a community. The scale of these 
improvements can be small and local through to large and global 


Statelessness 


The circumstances of people who do not have any legal bond of 
nationality or citizenship with any state. Included in this concept 
are the causes and consequences of statelessness 


Appendix C 
Described Proficiency Levels 


Level A: 563 score points and above 


Students working at Level A make connections between the processes of social and 
political organization and influence, and the legal and institutional mechanisms used 
to control them. They generate accurate hypotheses on the benefits, motivations, and 
likely outcomes of institutional policies and citizens’ actions. They integrate, justify, 
and evaluate given positions, policies, or laws based on the principles that underpin 
them. Students demonstrate familiarity with broad international economic forces and 
the strategic nature of active participation. 


Students working at Level A, for example: 


Identify likely strategic aims of a program of ethical consumption 

Suggest mechanisms by which open public debate and communication can benefit 
society 

Suggest related benefits of widespread intercultural understanding in society 
Justify the separation of powers between the judiciary and the parliament 

Relate the principle of fair and equal governance to laws regarding disclosure of 
financial donations to political parties 

Evaluate a policy with respect to equality and inclusiveness 

Identify a reason for having limited parliamentary terms 

Identify the main feature of free-market economies and multinational company 
ownership 


Level B: 479 to 562 score points 


Students working at Level B demonstrate familiarity with the broad concept of a 
representative democracy as a political system. They recognize ways in which insti- 
tutions and laws can be used to protect and promote a society’s values and principles. 
They recognize the potential role of citizens as voters in a representative democracy, 
and they generalize principles and values from specific examples of policies and laws 
(including human rights). Students demonstrate understanding of the influence that 
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active citizenship can have beyond the local community. They generalize the role of 
the individual active citizen to broader civic societies and the world. 


Students working at Level B, for example: 


e Relate the independence of a statutory authority to maintain public trust in 
decisions made by the authority 

e Generalize the economic risk to developing countries of globalization from a local 
context 

e Identify that informed citizens are better able to make decisions when voting in 
elections 
Relate the responsibility to vote with the representativeness of a democracy 
Describe the main role of a legislature/parliament 
Define the main role of a constitution 


Level C: 395 to 478 score points 


Students working at Level C demonstrate familiarity with equality, social cohe- 
sion, and freedom as principles of democracy. They relate these broad principles to 
everyday examples of situations in which protection of or challenge to the principles 
are demonstrated. Students also demonstrate familiarity with fundamental concepts 
of the individual as an active citizen: they recognize the necessity for individuals to 
obey the law; they relate individual courses of action to likely outcomes; and they 
relate personal characteristics to the capacity of an individual to effect civic change. 


Students working at Level C, for example: 


e Relate freedom of the press to the accuracy of information provided to the public 
by the media 
Justify voluntary voting in the context of freedom of political expression 
Identify that democratic leaders should be aware of the needs of the people over 
whom they have authority 

e Recognize that the UN Universal Declaration of Human Rights is intended to 
apply to all people 

e Generalize about the value of the internet as a communicative tool in civic 
participation 
Recognize the value of being an informed voter 
Recognize that governments have a responsibility to all citizens 
Recognize the civic motivation behind an act of ethical consumerism 


Level D: 311 to 394 score points 


Students working at Level D recognize explicit examples representing basic features 
of democracy. They identify the intended outcomes of simple examples of rules and 
laws and recognize the motivations of people engaged in activities that contribute to 
the common good. 
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Students working at Level D, for example: 


Recognize national defense is a key role of the military 

Relate the right to medical help to the motivation to work for an aid organization 
Recognize the relationship between the secret ballot and freedom of voter choice 
Recognize that volunteers provide a contribution to communities 

Recognize that all people are equal before the law 


Appendix D 


Example Test Items 


This appendix contains ten examples of test items that were used in the ICCS 2016 


Main Survey and 
in 2016, for conv 


cover a range of content domains. While the items were used 
enience, the content and cognitive domain references have been 


mapped to the ICCS 2022 Assessment Framework. For each example item, the 
following summary information is included: 


Cycle 


The ICCS cycle or cycles (2009 and/or 2016) when the item was included in 
the ICCS main survey instrument 


Cognitive domain 


The cognitive domain reference to the ICCS 2022 Assessment Framework 


Content domain 


The content domain reference to the ICCS 2022 Assessment Framework 


GCED 


An indication of whether this item is deemed to be relevant to the theme of 
global citizenship education for ICSS 2022 


ICCS level The proficiency level on the ICCS scale in which the item is located (A, B, 
C, D or below Level D) 
Item ID The unique item identifier used in the test and reported in the ICCS 2016 


International Database 


Key/Max score 


For multiple choice items, the key is the correct response. The key is 
numbered 1, 2, 3, or 4 to indicate the ordinal position of the correct response 
in the set of four response options. For the open-ended response item, the 
maximum score is shown 


Following the ten example items are descriptions of each of the three computer- 
enhanced clusters of items, including the tasks with dynamic feedback that were 
included in the ICCS 2022 Main Survey test instrument. 
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Example Item 1 


CI3REM1 ICCS level Below Level D Key 4 


2016 


jew ; 


Cognitive 


Content 


domain 2. Civic principles 


doman 1. Knowing 


‘Everyone has the right to education. Education shall be free...and compulsory.’ 
The Universal Declaration of Human Rights 


Q Why is education considered a human right? 


Because children enjoy going to school and spending time with their friends. 
Because education provides jobs for lots of teachers. 

Because children can be in school while their parents are working. 

Because education develops the skills people need to participate in their 
communities. 


Example Item 2 


CI3SPM1 ICCS level D 


Content 
domain 


Cognitive 


2. Civic principles 1. Knowing 


domain 


A government minister in <Exland> has been caught speeding in his car. He received a fine 
for breaking the road laws. 
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Q Why does the minister have to pay the fine? 


Because ministers have enough money to pay fines. 

The law treats everyone as equal. 

Because he wants people to vote for him again. 

Because the police can arrest him if he fails to pay the fine. 


Example Item 


CI3NWM1 ICCS level D 


2016 N 
Content 1. Civic institutions Cognitive ; ; 
domain and systems domain 2 eceoniig caciabe ring 


Many people in noisy workplaces in <Exland> have had their hearing damaged by the noise. 


Q What is the most reasonable action the government could take to deal with the 
problem of noisy workplaces? 


immediately close down all noisy workplaces 

give money to the workers to help them find jobs in quieter workplaces 
introduce laws stating that employers must protect workers from noise 
arrest all owners of noisy workplaces 
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Example Item 4 (paired in a unit with Example Item 5) 


CI3DBM1 D 2 
2016 Y 
Content 4. Civic roles and Cognitive : : 
domain identities domain 2 SOREN ART 320 


Doctors Without Borders is an organization where health professionals volunteer their 
time in countries where people require medical assistance. 


Q What is the most likely reason that people volunteer their time to such an 
organization? 


e Because they want to influence international human rights laws. 

e Because they believe all people deserve access to medical help. 

e Because it is the only way they can get practical experience of caring for patients. 
e Because health professionals find it difficult to get jobs. 


Example Item 131 (paired in a unit with Example Item) 


CI3131B ICCS level D 


2016 Y 
Content 4. Civic roles and Cognitive : : 
domain identities domain 2 Sofas) ile) eb es 


Doctors Without Borders chooses to limit the amount of money it receives from 
governments. It receives about 80% of its money from private sources. 
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Q What is the most likely reason Doctors Without Borders chooses to collect most 
of its money from private sources rather than governments? 


e Governments do not like organizations like Doctors Without Borders. 

e Governments do not have enough money to give to organizations such as Doctors 
Without Borders. 

Doctors Without Borders might want to create a political party that opposes many 
governments. 

Doctors Without Borders wishes to remain independent of governments and their 
policies. 


Example Item 6 


mm CI2JOM1 ICCS level C 


Content 
domain 


Cognitive 


2: Civic principles 2. Reasoning and applying 


domain 


Q Why is it important that journalists are freely able to research and report the news? 


It builds trust in the country’s government. 

It helps journalists to provide accurate information to the public. 

It ensures that there are enough journalists to report all news events. 

It makes sure that no individual journalist is paid too much money for their work. 


Example Item 7 


CI2BCM1 ICCS level B 


2016 N 
Content 3. Civic Cognitive F 
eRe) participation domain 1. Knowing 


Members of a youth club want to choose a leader. One member offers to be the leader, but 
the club members decide instead to vote to elect a leader. 
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Q What is the best reason for the club to elect the leader by a vote rather than 
choosing a person who offers to be the leader? 


Voting enables people to hold a second vote if they disagree with the outcome. 
Voting is the fastest way to decide who should be the leader. 

Voting enables every member of the club to participate in choosing the leader. 
Voting ensures that every member of the club will be happy with the choice of 
leader. 


Example Item 8 (paired in a unit with Example Item 9) 


js CI2ETM2 ICCS level B 


Content 


Cognitive 


2. Civic principles 2. Reasoning and applying 


domain 


domain 


Some businesses in <Exland> have begun to import fruit from another country at a very 
cheap price. Farmers in <Exland> are angry because they cannot afford to sell fruit at the 
same cheap price. Some people in <Exland> have decided to buy only fruit grown locally in 
<Exland>. 


CI2ETM2 


Q What is the best argument against protecting the < Exland > farmers’ businesses? 


People have the right to choose who they buy their fruit from. 

The farmers will be able to find some other way to make money. 

People will always buy the best quality fruit so the price does not matter. 

The farmers should just sell their fruit for less even though they cannot afford to. 
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Example Item 9 (paired in a unit with Example Item 8) 


CI2ETO1 ICCS level 


2009 & 2016 


Content 3. Civic Cognitive 


domain participation domain zoe aeoning andidepying 


Q How can choosing to buy only locally grown fruit help to protect the <Exland> 
farmers’ businesses? Write two different ways. 


Example Item 9: Scoring 


Score 2: Refers to ways of helping from two different categories of the three categories 
listed below. 


— 


provides the farmers with money 

2. keeps a position in the market for the farmers (relative to competitors) 

3. sets an example for other people to follow OR can lead to exposure for the farmers 
and/or their cause 


Code 1: Refers only to ways of helping from one of the three listed categories (including 
responses in which different ways of helping from the same category are provided). 


Code 0: Irrelevant OR incoherent OR repeats the question. 
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Example Item 136 


Content 


Cognitive 


2: Civic principles 2: Reasoning and applying 


domain 


domain 


Individuals or groups sometimes give money to political parties as donations. Some 
countries have laws that require political parties to give the public access to information 
about donations to parties. 


Q Why do countries have these laws? 


e The laws encourage people to vote for the political parties that receive fewer 
donations. 
The laws help the public to decide which party is likely to win the next election. 
The laws encourage more people to join the wealthy political parties. 
The laws discourage political parties from favouring the people who make the 
donations. 


Computer-enhanced cluster descriptions 


Below are summary descriptions of the contents of the three ICILS 2022 computer- 
enhanced test clusters, including the nature of the dynamic task within each clust 


Name Cluster and dynamic task description 


Sports club voting A sports club has decided to have members vote on club 

(5 items of varying difficulty) | decisions using an app. The questions in the cluster relate 
mainly to how different voting rules associated with configuring 
the app might affect the voting process and the legitimacy of the 
results of the voting process 
In the dynamic task, students configure the app (using radio 
buttons) to establish three of the rules governing the conduct of 
the vote. Students then receive a dynamically generated report 
on the number of people who voted and ‘feedback’ from voters 
about their perceptions of the voting process. Students use this 
information to evaluate the voting rules 


(continued) 
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(continued) 


Name 


Cluster and dynamic task description 


Charity organization 
(5 items of varying difficulty) 


Students are in the role of advisor to a charitable organization. 
Students evaluate and provide advice on how the organization 
can best allocate funds across three areas of its budget 
(marketing and fundraising; services; and administration), and 
on practices that will enable the charity to support its volunteers 
and clients 

In the dynamic task, students can manipulate the allocation of 
the budget across these three areas. As students increase or 
decrease the proportion of the budget allocated to any given 
area, they can see the impact that the increase or decrease has on 
what can be completed. Students are required to recommend the 
‘best’ balance of spending across the three areas 


School election 
(5 items of varying difficulty) 


Students contribute to the development of rules governing the 
election of class representatives at their school. The campaign 
has three candidates each of whom demonstrates very different 
behavior in their attempt to win support. Throughout the cluster 
students reflect on the relationship between the rules and their 
likely impact on the conduct of the school election 

In the dynamic task students select voting rules specifically to 
support the school election being free and fair. Students then 
evaluate how a rule not selected by them smay advantage or 
disadvantage the candidates based on the candidates’ expressed 
behaviors in the campaign 


Ziea FRE 
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